Nov 10 20:58:29 user nova-compute[75285]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75285) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75285) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75285) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 20:58:29 user nova-compute[75285]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 20:58:29 user nova-compute[75285]: INFO nova.virt.driver [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 10 20:58:29 user nova-compute[75285]: INFO nova.compute.provider_config [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] Acquiring lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] Acquired lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] Releasing lock "singleton_lock" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] Full set of CONF: {{(pid=75285) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ******************************************************************************** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] Configuration options gathered from: {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ================================================================================ {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] allow_resize_to_same_host      = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] arq_binding_timeout            = 300 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] backdoor_port                  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] backdoor_socket                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] block_device_allocate_retries  = 300 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] block_device_allocate_retries_interval = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cert                           = self.pem {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] compute_monitors               = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] config_dir                     = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] config_drive_format            = iso9660 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] config_source                  = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] console_host                   = user {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] control_exchange               = nova {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cpu_allocation_ratio           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] daemon                         = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] debug                          = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] default_access_ip_network_name = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] default_availability_zone      = nova {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] default_ephemeral_format       = ext4 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] default_green_pool_size        = 1000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] default_schedule_zone          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] disk_allocation_ratio          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] enable_new_services            = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] enabled_apis                   = ['osapi_compute'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] enabled_ssl_apis               = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] flat_injected                  = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] force_config_drive             = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] force_raw_images               = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] graceful_shutdown_timeout      = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] heal_instance_info_cache_interval = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] host                           = user {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] instance_build_timeout         = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] instance_delete_interval       = 300 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] instance_format                = [instance: %(uuid)s]  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] instance_name_template         = instance-%08x {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] instance_usage_audit           = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] instance_usage_audit_period    = month {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] internal_service_availability_zone = internal {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] key                            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] live_migration_retry_count     = 30 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] log_config_append              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] log_dir                        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] log_file                       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] log_options                    = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] log_rotate_interval            = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] log_rotate_interval_type       = days {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] log_rotation_type              = none {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] long_rpc_timeout               = 1800 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] max_concurrent_builds          = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] max_concurrent_live_migrations = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] max_concurrent_snapshots       = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] max_local_block_devices        = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] max_logfile_count              = 30 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] max_logfile_size_mb            = 200 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] maximum_instance_delete_attempts = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] metadata_listen                = 0.0.0.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] metadata_listen_port           = 8775 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] metadata_workers               = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] migrate_max_retries            = -1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] mkisofs_cmd                    = genisoimage {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] my_ip                          = 10.0.0.210 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] network_allocate_retries       = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] osapi_compute_listen_port      = 8774 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] osapi_compute_unique_server_name_scope =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] osapi_compute_workers          = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] password_length                = 12 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] periodic_enable                = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] periodic_fuzzy_delay           = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] pointer_model                  = ps2mouse {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] preallocate_images             = none {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] publish_errors                 = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] pybasedir                      = /opt/stack/nova {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ram_allocation_ratio           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] rate_limit_burst               = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] rate_limit_except_level        = CRITICAL {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] rate_limit_interval            = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] reboot_timeout                 = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] reclaim_instance_interval      = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] record                         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] reimage_timeout_per_gb         = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] report_interval                = 120 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] rescue_timeout                 = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] reserved_host_cpus             = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] reserved_host_disk_mb          = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] reserved_host_memory_mb        = 512 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] reserved_huge_pages            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] resize_confirm_window          = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] resize_fs_using_block_device   = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] resume_guests_state_on_host_boot = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] rpc_response_timeout           = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] run_external_periodic_tasks    = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] running_deleted_instance_action = reap {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] running_deleted_instance_poll_interval = 1800 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] running_deleted_instance_timeout = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] scheduler_instance_sync_interval = 120 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] service_down_time              = 720 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] servicegroup_driver            = db {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] shelved_offload_time           = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] shelved_poll_interval          = 3600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] shutdown_timeout               = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] source_is_ipv6                 = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ssl_only                       = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] state_path                     = /opt/stack/data/nova {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] sync_power_state_interval      = 600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] sync_power_state_pool_size     = 1000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] syslog_log_facility            = LOG_USER {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] tempdir                        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] timeout_nbd                    = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] transport_url                  = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] update_resources_interval      = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] use_cow_images                 = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] use_eventlog                   = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] use_journal                    = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] use_json                       = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] use_rootwrap_daemon            = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] use_stderr                     = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] use_syslog                     = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vcpu_pin_set                   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vif_plugging_is_fatal          = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vif_plugging_timeout           = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] virt_mkfs                      = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] volume_usage_poll_interval     = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] watch_log_file                 = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] web                            = /usr/share/spice-html5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_concurrency.disable_process_locking = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.auth_strategy              = keystone {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.compute_link_prefix        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.dhcp_domain                = novalocal {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.enable_instance_password   = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.glance_link_prefix         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.instance_list_per_project_cells = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.list_records_by_skipping_down_cells = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.local_metadata_per_cell    = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.max_limit                  = 1000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.metadata_cache_expiration  = 15 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.neutron_default_tenant_id  = default {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.use_forwarded_for          = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.use_neutron_default_nets   = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.vendordata_dynamic_targets = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.vendordata_jsonfile_path   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.backend                  = dogpile.cache.memcached {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.backend_argument         = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.config_prefix            = cache.oslo {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.dead_timeout             = 60.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.debug_cache_backend      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.enable_retry_client      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.enable_socket_keepalive  = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.enabled                  = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.expiration_time          = 600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.hashclient_retry_attempts = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.memcache_dead_retry      = 300 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.memcache_password        =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.memcache_pool_maxsize    = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.memcache_sasl_enabled    = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.memcache_username        =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.proxies                  = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.retry_attempts           = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.retry_delay              = 0.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.socket_keepalive_count   = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.socket_keepalive_idle    = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.socket_keepalive_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.tls_allowed_ciphers      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.tls_cafile               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.tls_certfile             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.tls_enabled              = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cache.tls_keyfile              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.auth_section            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.auth_type               = password {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.cafile                  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.certfile                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.collect_timing          = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.cross_az_attach         = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.debug                   = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.endpoint_template       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.http_retries            = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.insecure                = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.keyfile                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.os_region_name          = RegionOne {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.split_loggers           = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cinder.timeout                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] compute.cpu_dedicated_set      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] compute.cpu_shared_set         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] compute.image_type_exclude_list = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] compute.max_concurrent_disk_ops = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] compute.max_disk_devices_to_attach = -1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] compute.resource_provider_association_refresh = 300 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] compute.shutdown_retry_interval = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] conductor.workers              = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] console.allowed_origins        = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] console.ssl_ciphers            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] console.ssl_minimum_version    = default {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] consoleauth.token_ttl          = 600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.cafile                  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.certfile                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.collect_timing          = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.connect_retries         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.connect_retry_delay     = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.endpoint_override       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.insecure                = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.keyfile                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.max_version             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.min_version             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.region_name             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.service_name            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.service_type            = accelerator {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.split_loggers           = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.status_code_retries     = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.status_code_retry_delay = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.timeout                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] cyborg.version                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.backend               = sqlalchemy {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.connection            = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.connection_debug      = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.connection_parameters =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.connection_recycle_time = 3600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.connection_trace      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.db_inc_retry_interval = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.db_max_retries        = 20 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.db_max_retry_interval = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.db_retry_interval     = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.max_overflow          = 50 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.max_pool_size         = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.max_retries           = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.mysql_wsrep_sync_wait = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.pool_timeout          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.retry_interval        = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.slave_connection      = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] database.sqlite_synchronous    = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:29 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.backend           = sqlalchemy {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.connection        = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.connection_debug  = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.connection_parameters =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.connection_recycle_time = 3600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.connection_trace  = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.db_inc_retry_interval = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.db_max_retries    = 20 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.db_max_retry_interval = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.db_retry_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.max_overflow      = 50 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.max_pool_size     = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.max_retries       = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.pool_timeout      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.retry_interval    = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.slave_connection  = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] api_database.sqlite_synchronous = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] devices.enabled_mdev_types     = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ephemeral_storage_encryption.enabled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.api_servers             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.cafile                  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.certfile                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.collect_timing          = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.connect_retries         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.connect_retry_delay     = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.debug                   = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.default_trusted_certificate_ids = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.enable_certificate_validation = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.enable_rbd_download     = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.endpoint_override       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.insecure                = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.keyfile                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.max_version             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.min_version             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.num_retries             = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.rbd_ceph_conf           =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.rbd_connect_timeout     = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.rbd_pool                =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.rbd_user                =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.region_name             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.service_name            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.service_type            = image {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.split_loggers           = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.status_code_retries     = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.status_code_retry_delay = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.timeout                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.verify_glance_signatures = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] glance.version                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] guestfs.debug                  = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.config_drive_cdrom      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.config_drive_inject_password = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.enable_instance_metrics_collection = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.enable_remotefx         = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.instances_path_share    =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.iscsi_initiator_list    = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.limit_cpu_features      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.power_state_check_timeframe = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.use_multipath_io        = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.volume_attach_retry_count = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.vswitch_name            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] mks.enabled                    = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] image_cache.manager_interval   = 2400 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] image_cache.precache_concurrency = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] image_cache.remove_unused_base_images = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] image_cache.subdirectory_name  = _base {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.api_max_retries         = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.api_retry_interval      = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.auth_section            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.auth_type               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.cafile                  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.certfile                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.collect_timing          = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.conductor_group         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.connect_retries         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.connect_retry_delay     = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.endpoint_override       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.insecure                = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.keyfile                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.max_version             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.min_version             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.peer_list               = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.region_name             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.serial_console_state_timeout = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.service_name            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.service_type            = baremetal {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.split_loggers           = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.status_code_retries     = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.status_code_retry_delay = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.timeout                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ironic.version                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] key_manager.fixed_key          = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.barbican_api_version  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.barbican_endpoint     = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.barbican_endpoint_type = public {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.barbican_region_name  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.cafile                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.certfile              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.collect_timing        = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.insecure              = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.keyfile               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.number_of_retries     = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.retry_delay           = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.send_service_user_token = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.split_loggers         = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.timeout               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.verify_ssl            = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican.verify_ssl_path       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican_service_user.auth_section = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican_service_user.auth_type = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican_service_user.cafile   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican_service_user.certfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican_service_user.collect_timing = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican_service_user.insecure = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican_service_user.keyfile  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican_service_user.split_loggers = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] barbican_service_user.timeout  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.approle_role_id          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.approle_secret_id        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.cafile                   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.certfile                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.collect_timing           = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.insecure                 = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.keyfile                  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.kv_mountpoint            = secret {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.kv_path                  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.kv_version               = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.namespace                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.root_token_id            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.split_loggers            = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.ssl_ca_crt_file          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.timeout                  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.use_ssl                  = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.auth_section          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.auth_type             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.cafile                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.certfile              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.collect_timing        = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.connect_retries       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.connect_retry_delay   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.endpoint_override     = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.insecure              = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.keyfile               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.max_version           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.min_version           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.region_name           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.service_name          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.service_type          = identity {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.split_loggers         = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.status_code_retries   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.status_code_retry_delay = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.timeout               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] keystone.version               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.connection_uri         =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.cpu_mode               = custom {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: WARNING oslo_config.cfg [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.cpu_power_governor_high = performance {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.cpu_power_governor_low = powersave {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.cpu_power_management   = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.device_detach_attempts = 8 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.device_detach_timeout  = 20 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.disk_cachemodes        = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.disk_prefix            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.enabled_perf_events    = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.file_backed_memory     = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.gid_maps               = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.hw_disk_discard        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.hw_machine_type        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.images_rbd_glance_store_name =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.images_rbd_pool        = rbd {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.images_type            = default {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.images_volume_group    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.inject_key             = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.inject_partition       = -2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.inject_password        = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.iscsi_iface            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.iser_use_multipath     = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.live_migration_bandwidth = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.live_migration_downtime = 500 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.live_migration_inbound_addr = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.live_migration_permit_post_copy = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.live_migration_scheme  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.live_migration_timeout_action = abort {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.live_migration_tunnelled = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: WARNING oslo_config.cfg [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 10 20:58:30 user nova-compute[75285]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 10 20:58:30 user nova-compute[75285]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 10 20:58:30 user nova-compute[75285]: and ``live_migration_inbound_addr`` respectively.
Nov 10 20:58:30 user nova-compute[75285]: ).  Its value may be silently ignored in the future.
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.live_migration_with_native_tls = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.max_queues             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.nfs_mount_options      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.num_memory_encrypted_guests = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.num_pcie_ports         = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.pmem_namespaces        = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.quobyte_client_cfg     = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.rbd_secret_uuid        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.rbd_user               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.remote_filesystem_transport = ssh {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.rescue_image_id        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.rescue_kernel_id       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.rescue_ramdisk_id      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.rx_queue_size          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.smbfs_mount_options    =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.snapshot_compression   = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.snapshot_image_format  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.sparse_logical_volumes = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.swtpm_enabled          = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.swtpm_group            = tss {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.swtpm_user             = tss {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.sysinfo_serial         = unique {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.tb_cache_size          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.tx_queue_size          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.uid_maps               = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.use_virtio_for_bridges = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.virt_type              = kvm {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.volume_clear           = zero {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.volume_clear_size      = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.volume_use_multipath   = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.vzstorage_cache_path   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.vzstorage_mount_user   = stack {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.auth_section           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.auth_type              = password {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.cafile                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.certfile               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.collect_timing         = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.connect_retries        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.connect_retry_delay    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.default_floating_pool  = public {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.endpoint_override      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.extension_sync_interval = 600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.http_retries           = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.insecure               = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.keyfile                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.max_version            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.min_version            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.ovs_bridge             = br-int {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.physnets               = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.region_name            = RegionOne {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.service_metadata_proxy = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.service_name           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.service_type           = network {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.split_loggers          = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.status_code_retries    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.status_code_retry_delay = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.timeout                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] neutron.version                = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] notifications.bdms_in_notifications = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] notifications.default_level    = INFO {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] notifications.notification_format = unversioned {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] notifications.notify_on_state_change = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] pci.alias                      = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] pci.device_spec                = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] pci.report_in_placement        = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.auth_section         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.auth_type            = password {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.cafile               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.certfile             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.collect_timing       = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.connect_retries      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.connect_retry_delay  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.default_domain_id    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.default_domain_name  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.domain_id            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.domain_name          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.endpoint_override    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.insecure             = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.keyfile              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.max_version          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.min_version          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.password             = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.project_domain_id    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.project_domain_name  = Default {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.project_id           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.project_name         = service {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.region_name          = RegionOne {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.service_name         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.service_type         = placement {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.split_loggers        = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.status_code_retries  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.status_code_retry_delay = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.system_scope         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.timeout              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.trust_id             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.user_domain_id       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.user_domain_name     = Default {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.user_id              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.username             = placement {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] placement.version              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] quota.cores                    = 20 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] quota.count_usage_from_placement = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] quota.injected_file_content_bytes = 10240 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] quota.injected_file_path_length = 255 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] quota.injected_files           = 5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] quota.instances                = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] quota.key_pairs                = 100 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] quota.metadata_items           = 128 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] quota.ram                      = 51200 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] quota.recheck_quota            = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] quota.server_group_members     = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] quota.server_groups            = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] rdp.enabled                    = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] scheduler.image_metadata_prefilter = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] scheduler.max_attempts         = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] scheduler.max_placement_results = 1000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] scheduler.query_placement_for_image_type_support = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] scheduler.workers              = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.host_subset_size = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.isolated_hosts = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.isolated_images = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.pci_in_placement = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.track_instance_changes = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] metrics.required               = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] metrics.weight_multiplier      = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] metrics.weight_setting         = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] serial_console.enabled         = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] serial_console.port_range      = 10000:20000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] serial_console.serialproxy_port = 6083 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] service_user.auth_section      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] service_user.auth_type         = password {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] service_user.cafile            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] service_user.certfile          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] service_user.collect_timing    = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] service_user.insecure          = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] service_user.keyfile           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] service_user.send_service_user_token = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] service_user.split_loggers     = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] service_user.timeout           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] spice.agent_enabled            = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] spice.enabled                  = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] spice.html5proxy_port          = 6082 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] spice.image_compression        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] spice.jpeg_compression         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] spice.playback_compression     = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] spice.server_listen            = 127.0.0.1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] spice.streaming_mode           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] spice.zlib_compression         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] upgrade_levels.baseapi         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] upgrade_levels.cert            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] upgrade_levels.compute         = auto {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] upgrade_levels.conductor       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] upgrade_levels.scheduler       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vendordata_dynamic_auth.auth_section = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vendordata_dynamic_auth.auth_type = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vendordata_dynamic_auth.cafile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vendordata_dynamic_auth.certfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vendordata_dynamic_auth.insecure = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vendordata_dynamic_auth.keyfile = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vendordata_dynamic_auth.timeout = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.api_retry_count         = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.ca_file                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.cache_prefix            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.cluster_name            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.connection_pool_size    = 10 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.console_delay_seconds   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.datastore_regex         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.host_ip                 = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.host_password           = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.host_port               = 443 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.host_username           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.insecure                = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.integration_bridge      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.maximum_objects         = 100 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.pbm_default_policy      = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.pbm_enabled             = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.pbm_wsdl_location       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.serial_port_proxy_uri   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.serial_port_service_uri = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.task_poll_interval      = 0.5 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.use_linked_clone        = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.vnc_keymap              = en-us {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.vnc_port                = 5900 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vmware.vnc_port_total          = 10000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vnc.auth_schemes               = ['none'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vnc.enabled                    = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vnc.novncproxy_port            = 6080 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vnc.server_listen              = 0.0.0.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vnc.vencrypt_ca_certs          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vnc.vencrypt_client_cert       = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vnc.vencrypt_client_key        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.disable_rootwrap   = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.enable_numa_live_migration = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.libvirt_disable_apic = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] wsgi.client_socket_timeout     = 900 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] wsgi.default_pool_size         = 1000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] wsgi.keep_alive                = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] wsgi.max_header_line           = 16384 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] wsgi.ssl_ca_file               = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] wsgi.ssl_cert_file             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] wsgi.ssl_key_file              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] wsgi.tcp_keepidle              = 600 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] zvm.ca_file                    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] zvm.cloud_connector_url        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] zvm.reachable_timeout          = 300 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_policy.enforce_new_defaults = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_policy.enforce_scope      = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_policy.policy_default_rule = default {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_policy.policy_file        = policy.yaml {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] profiler.connection_string     = messaging:// {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] profiler.enabled               = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] profiler.es_doc_type           = notification {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] profiler.es_scroll_size        = 10000 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] profiler.es_scroll_time        = 2m {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] profiler.filter_error_trace    = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] profiler.hmac_keys             = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] profiler.sentinel_service_name = mymaster {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] profiler.socket_timeout        = 0.1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] profiler.trace_requests        = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] profiler.trace_sqlalchemy      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] profiler_jaeger.process_tags   = {} {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] profiler_jaeger.service_name_prefix = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] profiler_otlp.service_name_prefix = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] remote_debug.host              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] remote_debug.port              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.ssl      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_notifications.retry = -1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_messaging_notifications.transport_url = **** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.auth_section        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.auth_type           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.cafile              = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.certfile            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.collect_timing      = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.connect_retries     = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.connect_retry_delay = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.endpoint_id         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.endpoint_override   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.insecure            = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.keyfile             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.max_version         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.min_version         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.region_name         = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.service_name        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.service_type        = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.split_loggers       = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.status_code_retries = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.status_code_retry_delay = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.timeout             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.valid_interfaces    = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_limit.version             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_reports.file_event_handler = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] oslo_reports.log_dir           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vif_plug_ovs_privileged.group  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] vif_plug_ovs_privileged.user   = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_linux_bridge.flat_interface = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_ovs.isolate_vif         = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_vif_ovs.per_port_bridge     = False {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] os_brick.lock_path             = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] privsep_osbrick.capabilities   = [21] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] privsep_osbrick.group          = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] privsep_osbrick.helper_command = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] privsep_osbrick.user           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] nova_sys_admin.group           = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] nova_sys_admin.helper_command  = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] nova_sys_admin.user            = None {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG oslo_service.service [None req-47347068-df7d-41bd-86e8-ab5f8a4bca4f None None] ******************************************************************************** {{(pid=75285) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 10 20:58:30 user nova-compute[75285]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 10 20:58:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Connecting to libvirt: qemu:///system {{(pid=75285) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4a0582f070> {{(pid=75285) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 10 20:58:30 user nova-compute[75285]: libvirt:  error : internal error: could not initialize domain event timer
Nov 10 20:58:30 user nova-compute[75285]: WARNING nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 10 20:58:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4a0582f070> {{(pid=75285) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Starting native event thread {{(pid=75285) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Starting green dispatch thread {{(pid=75285) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 10 20:58:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Starting connection event dispatch thread {{(pid=75285) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 10 20:58:30 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Connection event '1' reason 'None'
Nov 10 20:58:30 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 20:58:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.mount [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Initialising _HostMountState generation 0 {{(pid=75285) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 10 20:58:37 user nova-compute[75285]: INFO nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Libvirt host capabilities <capabilities>
Nov 10 20:58:37 user nova-compute[75285]:   <host>
Nov 10 20:58:37 user nova-compute[75285]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 10 20:58:37 user nova-compute[75285]:     <cpu>
Nov 10 20:58:37 user nova-compute[75285]:       <arch>x86_64</arch>
Nov 10 20:58:37 user nova-compute[75285]:       <model>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <vendor>Intel</vendor>
Nov 10 20:58:37 user nova-compute[75285]:       <microcode version='1070'/>
Nov 10 20:58:37 user nova-compute[75285]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 10 20:58:37 user nova-compute[75285]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature name='ss'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature name='vmx'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature name='pcid'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature name='osxsave'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature name='hypervisor'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature name='arat'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature name='tsc_adjust'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature name='md-clear'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature name='stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature name='arch-capabilities'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature name='ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature name='invtsc'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature name='rsba'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature name='skip-l1dfl-vmentry'/>
Nov 10 20:58:37 user nova-compute[75285]:       <pages unit='KiB' size='4'/>
Nov 10 20:58:37 user nova-compute[75285]:       <pages unit='KiB' size='2048'/>
Nov 10 20:58:37 user nova-compute[75285]:     </cpu>
Nov 10 20:58:37 user nova-compute[75285]:     <power_management>
Nov 10 20:58:37 user nova-compute[75285]:       <suspend_mem/>
Nov 10 20:58:37 user nova-compute[75285]:       <suspend_disk/>
Nov 10 20:58:37 user nova-compute[75285]:       <suspend_hybrid/>
Nov 10 20:58:37 user nova-compute[75285]:     </power_management>
Nov 10 20:58:37 user nova-compute[75285]:     <iommu support='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     <migration_features>
Nov 10 20:58:37 user nova-compute[75285]:       <live/>
Nov 10 20:58:37 user nova-compute[75285]:       <uri_transports>
Nov 10 20:58:37 user nova-compute[75285]:         <uri_transport>tcp</uri_transport>
Nov 10 20:58:37 user nova-compute[75285]:         <uri_transport>rdma</uri_transport>
Nov 10 20:58:37 user nova-compute[75285]:       </uri_transports>
Nov 10 20:58:37 user nova-compute[75285]:     </migration_features>
Nov 10 20:58:37 user nova-compute[75285]:     <topology>
Nov 10 20:58:37 user nova-compute[75285]:       <cells num='2'>
Nov 10 20:58:37 user nova-compute[75285]:         <cell id='0'>
Nov 10 20:58:37 user nova-compute[75285]:           <memory unit='KiB'>8189224</memory>
Nov 10 20:58:37 user nova-compute[75285]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 10 20:58:37 user nova-compute[75285]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 20:58:37 user nova-compute[75285]:           <distances>
Nov 10 20:58:37 user nova-compute[75285]:             <sibling id='0' value='10'/>
Nov 10 20:58:37 user nova-compute[75285]:             <sibling id='1' value='20'/>
Nov 10 20:58:37 user nova-compute[75285]:           </distances>
Nov 10 20:58:37 user nova-compute[75285]:           <cpus num='6'>
Nov 10 20:58:37 user nova-compute[75285]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 10 20:58:37 user nova-compute[75285]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 10 20:58:37 user nova-compute[75285]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 10 20:58:37 user nova-compute[75285]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 10 20:58:37 user nova-compute[75285]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 10 20:58:37 user nova-compute[75285]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 10 20:58:37 user nova-compute[75285]:           </cpus>
Nov 10 20:58:37 user nova-compute[75285]:         </cell>
Nov 10 20:58:37 user nova-compute[75285]:         <cell id='1'>
Nov 10 20:58:37 user nova-compute[75285]:           <memory unit='KiB'>8206460</memory>
Nov 10 20:58:37 user nova-compute[75285]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 10 20:58:37 user nova-compute[75285]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 20:58:37 user nova-compute[75285]:           <distances>
Nov 10 20:58:37 user nova-compute[75285]:             <sibling id='0' value='20'/>
Nov 10 20:58:37 user nova-compute[75285]:             <sibling id='1' value='10'/>
Nov 10 20:58:37 user nova-compute[75285]:           </distances>
Nov 10 20:58:37 user nova-compute[75285]:           <cpus num='6'>
Nov 10 20:58:37 user nova-compute[75285]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 10 20:58:37 user nova-compute[75285]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 10 20:58:37 user nova-compute[75285]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 10 20:58:37 user nova-compute[75285]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 10 20:58:37 user nova-compute[75285]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 10 20:58:37 user nova-compute[75285]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 10 20:58:37 user nova-compute[75285]:           </cpus>
Nov 10 20:58:37 user nova-compute[75285]:         </cell>
Nov 10 20:58:37 user nova-compute[75285]:       </cells>
Nov 10 20:58:37 user nova-compute[75285]:     </topology>
Nov 10 20:58:37 user nova-compute[75285]:     <cache>
Nov 10 20:58:37 user nova-compute[75285]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 10 20:58:37 user nova-compute[75285]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 10 20:58:37 user nova-compute[75285]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 10 20:58:37 user nova-compute[75285]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 10 20:58:37 user nova-compute[75285]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 10 20:58:37 user nova-compute[75285]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 10 20:58:37 user nova-compute[75285]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 10 20:58:37 user nova-compute[75285]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 10 20:58:37 user nova-compute[75285]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 10 20:58:37 user nova-compute[75285]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 10 20:58:37 user nova-compute[75285]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 10 20:58:37 user nova-compute[75285]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 10 20:58:37 user nova-compute[75285]:     </cache>
Nov 10 20:58:37 user nova-compute[75285]:     <secmodel>
Nov 10 20:58:37 user nova-compute[75285]:       <model>apparmor</model>
Nov 10 20:58:37 user nova-compute[75285]:       <doi>0</doi>
Nov 10 20:58:37 user nova-compute[75285]:     </secmodel>
Nov 10 20:58:37 user nova-compute[75285]:     <secmodel>
Nov 10 20:58:37 user nova-compute[75285]:       <model>dac</model>
Nov 10 20:58:37 user nova-compute[75285]:       <doi>0</doi>
Nov 10 20:58:37 user nova-compute[75285]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 10 20:58:37 user nova-compute[75285]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 10 20:58:37 user nova-compute[75285]:     </secmodel>
Nov 10 20:58:37 user nova-compute[75285]:   </host>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='alpha'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>64</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>clipper</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='armv6l'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>spitz</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>nuri</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>kzm</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sx1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>z2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>tosa</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>n810</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>n800</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>terrier</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>midway</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>microbit</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>verdex</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>highbank</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>akita</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>connex</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>collie</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='armv7l'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>spitz</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>nuri</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>kzm</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sx1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>z2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>tosa</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>n810</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>n800</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>terrier</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>midway</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>microbit</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>verdex</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>highbank</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>akita</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>connex</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>collie</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='aarch64'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>64</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>spitz</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>nuri</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>kzm</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sx1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>z2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>tosa</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>n810</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>n800</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>terrier</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>midway</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>microbit</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>verdex</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>raspi3b</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>highbank</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>akita</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>connex</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>collie</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <acpi default='on' toggle='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='cris'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='i686'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>isapc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>microvm</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='kvm'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <pae/>
Nov 10 20:58:37 user nova-compute[75285]:       <nonpae/>
Nov 10 20:58:37 user nova-compute[75285]:       <acpi default='on' toggle='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:       <apic default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='m68k'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>an5206</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>q800</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>next-cube</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='microblaze'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='microblazeel'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='mips'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='16'>malta</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='mipsel'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='16'>malta</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='mips64'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>64</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='16'>malta</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>pica61</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>magnum</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='mips64el'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>64</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='16'>malta</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>pica61</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>magnum</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='16'>boston</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='ppc'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mac99</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>40p</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>taihu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='ppc64'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>64</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>taihu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>40p</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mac99</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='ppc64le'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>64</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>taihu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>40p</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>mac99</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='riscv32'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='8'>spike</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>opentitan</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='8'>virt</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='riscv64'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>64</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='8'>spike</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>shakti_c</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='8'>virt</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='s390x'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>64</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='sh4'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>shix</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>r2d</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='sh4eb'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>64</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>shix</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>r2d</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='sparc'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>SS-5</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>SS-20</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>LX</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>SS-4</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>SS-10</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>Voyager</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='sparc64'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>64</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sun4u</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>niagara</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>sun4v</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='x86_64'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>64</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='1'>isapc</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>microvm</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='kvm'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <acpi default='on' toggle='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:       <apic default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='xtensa'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>sim</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>kc705</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>ml605</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>virt</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>lx200</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>lx60</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]:   <guest>
Nov 10 20:58:37 user nova-compute[75285]:     <os_type>hvm</os_type>
Nov 10 20:58:37 user nova-compute[75285]:     <arch name='xtensaeb'>
Nov 10 20:58:37 user nova-compute[75285]:       <wordsize>32</wordsize>
Nov 10 20:58:37 user nova-compute[75285]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='4'>sim</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>kc705</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>ml605</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>virt</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>lx200</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>lx60</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 20:58:37 user nova-compute[75285]:       <domain type='qemu'/>
Nov 10 20:58:37 user nova-compute[75285]:     </arch>
Nov 10 20:58:37 user nova-compute[75285]:     <features>
Nov 10 20:58:37 user nova-compute[75285]:       <cpuselection/>
Nov 10 20:58:37 user nova-compute[75285]:       <deviceboot/>
Nov 10 20:58:37 user nova-compute[75285]:       <disksnapshot default='on' toggle='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     </features>
Nov 10 20:58:37 user nova-compute[75285]:   </guest>
Nov 10 20:58:37 user nova-compute[75285]: </capabilities>
Nov 10 20:58:37 user nova-compute[75285]: 
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 10 20:58:37 user nova-compute[75285]: <domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 20:58:37 user nova-compute[75285]:   <domain>kvm</domain>
Nov 10 20:58:37 user nova-compute[75285]:   <machine>pc-i440fx-jammy</machine>
Nov 10 20:58:37 user nova-compute[75285]:   <arch>i686</arch>
Nov 10 20:58:37 user nova-compute[75285]:   <vcpu max='255'/>
Nov 10 20:58:37 user nova-compute[75285]:   <iothreads supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:   <os supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='firmware'/>
Nov 10 20:58:37 user nova-compute[75285]:     <loader supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>rom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pflash</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='readonly'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>yes</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='secure'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </loader>
Nov 10 20:58:37 user nova-compute[75285]:   </os>
Nov 10 20:58:37 user nova-compute[75285]:   <cpu>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-passthrough' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='hostPassthroughMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='maximum' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='maximumMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>on</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-model' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <vendor>Intel</vendor>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ss'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='vmx'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='pcid'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='hypervisor'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arat'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='umip'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='md-clear'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibpb'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibrs'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='erms'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='lm'/>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='custom' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>qemu64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>qemu32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>phenom</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>n270</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>kvm64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>kvm32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>coreduo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>core2duo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>athlon</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Westmere</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Snowridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Penryn</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G5</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G4</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G1</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Nehalem</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Rome</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Milan</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Dhyana</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cooperlake</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Conroe</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>486</model>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:   </cpu>
Nov 10 20:58:37 user nova-compute[75285]:   <memoryBacking supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='sourceType'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>file</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>anonymous</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>memfd</value>
Nov 10 20:58:37 user nova-compute[75285]:     </enum>
Nov 10 20:58:37 user nova-compute[75285]:   </memoryBacking>
Nov 10 20:58:37 user nova-compute[75285]:   <devices>
Nov 10 20:58:37 user nova-compute[75285]:     <disk supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='diskDevice'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>disk</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cdrom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>floppy</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>lun</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='bus'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>ide</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>fdc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sata</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </disk>
Nov 10 20:58:37 user nova-compute[75285]:     <graphics supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sdl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vnc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>spice</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egl-headless</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </graphics>
Nov 10 20:58:37 user nova-compute[75285]:     <video supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='modelType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cirrus</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vmvga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>qxl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>none</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>bochs</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>ramfb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </video>
Nov 10 20:58:37 user nova-compute[75285]:     <hostdev supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='mode'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>subsystem</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='startupPolicy'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>default</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>mandatory</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>requisite</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>optional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='subsysType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pci</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='capsType'/>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='pciBackend'/>
Nov 10 20:58:37 user nova-compute[75285]:     </hostdev>
Nov 10 20:58:37 user nova-compute[75285]:     <rng supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>random</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egd</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>builtin</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </rng>
Nov 10 20:58:37 user nova-compute[75285]:     <filesystem supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='driverType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>path</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>handle</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtiofs</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </filesystem>
Nov 10 20:58:37 user nova-compute[75285]:     <tpm supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-tis</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-crb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>passthrough</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>emulator</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </tpm>
Nov 10 20:58:37 user nova-compute[75285]:   </devices>
Nov 10 20:58:37 user nova-compute[75285]:   <features>
Nov 10 20:58:37 user nova-compute[75285]:     <gic supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     <vmcoreinfo supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <genid supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backingStoreInput supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backup supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <sev supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:   </features>
Nov 10 20:58:37 user nova-compute[75285]: </domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:  {{(pid=75285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 10 20:58:37 user nova-compute[75285]: <domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 20:58:37 user nova-compute[75285]:   <domain>kvm</domain>
Nov 10 20:58:37 user nova-compute[75285]:   <machine>pc-q35-jammy</machine>
Nov 10 20:58:37 user nova-compute[75285]:   <arch>i686</arch>
Nov 10 20:58:37 user nova-compute[75285]:   <vcpu max='288'/>
Nov 10 20:58:37 user nova-compute[75285]:   <iothreads supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:   <os supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='firmware'/>
Nov 10 20:58:37 user nova-compute[75285]:     <loader supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>rom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pflash</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='readonly'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>yes</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='secure'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </loader>
Nov 10 20:58:37 user nova-compute[75285]:   </os>
Nov 10 20:58:37 user nova-compute[75285]:   <cpu>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-passthrough' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='hostPassthroughMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='maximum' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='maximumMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>on</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-model' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <vendor>Intel</vendor>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ss'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='vmx'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='pcid'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='hypervisor'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arat'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='umip'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='md-clear'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibpb'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibrs'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='erms'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='lm'/>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='custom' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>qemu64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>qemu32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>phenom</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>n270</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>kvm64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>kvm32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>coreduo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>core2duo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>athlon</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Westmere</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Snowridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Penryn</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G5</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G4</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G1</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Nehalem</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Rome</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Milan</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Dhyana</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cooperlake</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Conroe</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>486</model>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:   </cpu>
Nov 10 20:58:37 user nova-compute[75285]:   <memoryBacking supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='sourceType'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>file</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>anonymous</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>memfd</value>
Nov 10 20:58:37 user nova-compute[75285]:     </enum>
Nov 10 20:58:37 user nova-compute[75285]:   </memoryBacking>
Nov 10 20:58:37 user nova-compute[75285]:   <devices>
Nov 10 20:58:37 user nova-compute[75285]:     <disk supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='diskDevice'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>disk</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cdrom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>floppy</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>lun</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='bus'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>fdc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sata</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </disk>
Nov 10 20:58:37 user nova-compute[75285]:     <graphics supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sdl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vnc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>spice</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egl-headless</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </graphics>
Nov 10 20:58:37 user nova-compute[75285]:     <video supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='modelType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cirrus</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vmvga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>qxl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>none</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>bochs</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>ramfb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </video>
Nov 10 20:58:37 user nova-compute[75285]:     <hostdev supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='mode'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>subsystem</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='startupPolicy'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>default</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>mandatory</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>requisite</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>optional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='subsysType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pci</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='capsType'/>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='pciBackend'/>
Nov 10 20:58:37 user nova-compute[75285]:     </hostdev>
Nov 10 20:58:37 user nova-compute[75285]:     <rng supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>random</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egd</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>builtin</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </rng>
Nov 10 20:58:37 user nova-compute[75285]:     <filesystem supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='driverType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>path</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>handle</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtiofs</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </filesystem>
Nov 10 20:58:37 user nova-compute[75285]:     <tpm supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-tis</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-crb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>passthrough</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>emulator</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </tpm>
Nov 10 20:58:37 user nova-compute[75285]:   </devices>
Nov 10 20:58:37 user nova-compute[75285]:   <features>
Nov 10 20:58:37 user nova-compute[75285]:     <gic supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     <vmcoreinfo supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <genid supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backingStoreInput supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backup supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <sev supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:   </features>
Nov 10 20:58:37 user nova-compute[75285]: </domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:  {{(pid=75285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 10 20:58:37 user nova-compute[75285]: <domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 20:58:37 user nova-compute[75285]:   <domain>kvm</domain>
Nov 10 20:58:37 user nova-compute[75285]:   <machine>pc-q35-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:   <arch>i686</arch>
Nov 10 20:58:37 user nova-compute[75285]:   <vcpu max='288'/>
Nov 10 20:58:37 user nova-compute[75285]:   <iothreads supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:   <os supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='firmware'/>
Nov 10 20:58:37 user nova-compute[75285]:     <loader supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>rom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pflash</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='readonly'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>yes</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='secure'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </loader>
Nov 10 20:58:37 user nova-compute[75285]:   </os>
Nov 10 20:58:37 user nova-compute[75285]:   <cpu>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-passthrough' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='hostPassthroughMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='maximum' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='maximumMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>on</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-model' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <vendor>Intel</vendor>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ss'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='vmx'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='pcid'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='hypervisor'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arat'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='umip'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='md-clear'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibpb'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibrs'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='erms'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='lm'/>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='custom' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>qemu64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>qemu32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>phenom</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>n270</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>kvm64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>kvm32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>coreduo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>core2duo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>athlon</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Westmere</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Snowridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Penryn</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G5</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G4</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G1</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Nehalem</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Rome</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Milan</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Dhyana</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cooperlake</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Conroe</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>486</model>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:   </cpu>
Nov 10 20:58:37 user nova-compute[75285]:   <memoryBacking supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='sourceType'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>file</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>anonymous</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>memfd</value>
Nov 10 20:58:37 user nova-compute[75285]:     </enum>
Nov 10 20:58:37 user nova-compute[75285]:   </memoryBacking>
Nov 10 20:58:37 user nova-compute[75285]:   <devices>
Nov 10 20:58:37 user nova-compute[75285]:     <disk supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='diskDevice'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>disk</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cdrom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>floppy</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>lun</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='bus'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>fdc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sata</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </disk>
Nov 10 20:58:37 user nova-compute[75285]:     <graphics supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sdl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vnc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>spice</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egl-headless</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </graphics>
Nov 10 20:58:37 user nova-compute[75285]:     <video supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='modelType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cirrus</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vmvga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>qxl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>none</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>bochs</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>ramfb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </video>
Nov 10 20:58:37 user nova-compute[75285]:     <hostdev supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='mode'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>subsystem</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='startupPolicy'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>default</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>mandatory</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>requisite</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>optional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='subsysType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pci</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='capsType'/>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='pciBackend'/>
Nov 10 20:58:37 user nova-compute[75285]:     </hostdev>
Nov 10 20:58:37 user nova-compute[75285]:     <rng supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>random</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egd</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>builtin</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </rng>
Nov 10 20:58:37 user nova-compute[75285]:     <filesystem supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='driverType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>path</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>handle</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtiofs</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </filesystem>
Nov 10 20:58:37 user nova-compute[75285]:     <tpm supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-tis</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-crb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>passthrough</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>emulator</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </tpm>
Nov 10 20:58:37 user nova-compute[75285]:   </devices>
Nov 10 20:58:37 user nova-compute[75285]:   <features>
Nov 10 20:58:37 user nova-compute[75285]:     <gic supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     <vmcoreinfo supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <genid supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backingStoreInput supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backup supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <sev supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:   </features>
Nov 10 20:58:37 user nova-compute[75285]: </domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:  {{(pid=75285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 10 20:58:37 user nova-compute[75285]: <domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 20:58:37 user nova-compute[75285]:   <domain>kvm</domain>
Nov 10 20:58:37 user nova-compute[75285]:   <machine>pc-i440fx-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:   <arch>i686</arch>
Nov 10 20:58:37 user nova-compute[75285]:   <vcpu max='255'/>
Nov 10 20:58:37 user nova-compute[75285]:   <iothreads supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:   <os supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='firmware'/>
Nov 10 20:58:37 user nova-compute[75285]:     <loader supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>rom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pflash</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='readonly'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>yes</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='secure'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </loader>
Nov 10 20:58:37 user nova-compute[75285]:   </os>
Nov 10 20:58:37 user nova-compute[75285]:   <cpu>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-passthrough' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='hostPassthroughMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='maximum' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='maximumMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>on</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-model' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <vendor>Intel</vendor>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ss'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='vmx'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='pcid'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='hypervisor'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arat'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='umip'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='md-clear'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibpb'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibrs'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='erms'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='lm'/>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='custom' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>qemu64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>qemu32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>phenom</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>n270</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>kvm64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>kvm32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>coreduo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>core2duo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>athlon</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Westmere</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Snowridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Penryn</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G5</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G4</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G1</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Nehalem</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Rome</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Milan</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Dhyana</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cooperlake</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Conroe</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>486</model>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:   </cpu>
Nov 10 20:58:37 user nova-compute[75285]:   <memoryBacking supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='sourceType'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>file</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>anonymous</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>memfd</value>
Nov 10 20:58:37 user nova-compute[75285]:     </enum>
Nov 10 20:58:37 user nova-compute[75285]:   </memoryBacking>
Nov 10 20:58:37 user nova-compute[75285]:   <devices>
Nov 10 20:58:37 user nova-compute[75285]:     <disk supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='diskDevice'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>disk</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cdrom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>floppy</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>lun</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='bus'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>ide</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>fdc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sata</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </disk>
Nov 10 20:58:37 user nova-compute[75285]:     <graphics supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sdl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vnc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>spice</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egl-headless</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </graphics>
Nov 10 20:58:37 user nova-compute[75285]:     <video supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='modelType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cirrus</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vmvga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>qxl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>none</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>bochs</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>ramfb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </video>
Nov 10 20:58:37 user nova-compute[75285]:     <hostdev supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='mode'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>subsystem</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='startupPolicy'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>default</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>mandatory</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>requisite</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>optional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='subsysType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pci</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='capsType'/>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='pciBackend'/>
Nov 10 20:58:37 user nova-compute[75285]:     </hostdev>
Nov 10 20:58:37 user nova-compute[75285]:     <rng supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>random</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egd</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>builtin</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </rng>
Nov 10 20:58:37 user nova-compute[75285]:     <filesystem supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='driverType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>path</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>handle</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtiofs</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </filesystem>
Nov 10 20:58:37 user nova-compute[75285]:     <tpm supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-tis</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-crb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>passthrough</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>emulator</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </tpm>
Nov 10 20:58:37 user nova-compute[75285]:   </devices>
Nov 10 20:58:37 user nova-compute[75285]:   <features>
Nov 10 20:58:37 user nova-compute[75285]:     <gic supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     <vmcoreinfo supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <genid supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backingStoreInput supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backup supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <sev supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:   </features>
Nov 10 20:58:37 user nova-compute[75285]: </domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:  {{(pid=75285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 10 20:58:37 user nova-compute[75285]: <domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 20:58:37 user nova-compute[75285]:   <domain>kvm</domain>
Nov 10 20:58:37 user nova-compute[75285]:   <machine>pc-i440fx-jammy</machine>
Nov 10 20:58:37 user nova-compute[75285]:   <arch>x86_64</arch>
Nov 10 20:58:37 user nova-compute[75285]:   <vcpu max='255'/>
Nov 10 20:58:37 user nova-compute[75285]:   <iothreads supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:   <os supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='firmware'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>efi</value>
Nov 10 20:58:37 user nova-compute[75285]:     </enum>
Nov 10 20:58:37 user nova-compute[75285]:     <loader supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>rom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pflash</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='readonly'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>yes</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='secure'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </loader>
Nov 10 20:58:37 user nova-compute[75285]:   </os>
Nov 10 20:58:37 user nova-compute[75285]:   <cpu>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-passthrough' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='hostPassthroughMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>on</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='maximum' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='maximumMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>on</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-model' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <vendor>Intel</vendor>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ss'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='vmx'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='pcid'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='hypervisor'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arat'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='umip'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='md-clear'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='invtsc'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibpb'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibrs'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='rsba'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='erms'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='custom' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>qemu64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>qemu32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>phenom</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>n270</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>kvm64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>kvm32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>coreduo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>core2duo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>athlon</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Westmere</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Snowridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Penryn</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G5</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G4</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Opteron_G1</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Nehalem</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Rome</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Milan</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Dhyana</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cooperlake</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Conroe</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>486</model>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:   </cpu>
Nov 10 20:58:37 user nova-compute[75285]:   <memoryBacking supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='sourceType'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>file</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>anonymous</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>memfd</value>
Nov 10 20:58:37 user nova-compute[75285]:     </enum>
Nov 10 20:58:37 user nova-compute[75285]:   </memoryBacking>
Nov 10 20:58:37 user nova-compute[75285]:   <devices>
Nov 10 20:58:37 user nova-compute[75285]:     <disk supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='diskDevice'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>disk</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cdrom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>floppy</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>lun</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='bus'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>ide</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>fdc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sata</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </disk>
Nov 10 20:58:37 user nova-compute[75285]:     <graphics supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sdl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vnc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>spice</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egl-headless</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </graphics>
Nov 10 20:58:37 user nova-compute[75285]:     <video supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='modelType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cirrus</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vmvga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>qxl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>none</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>bochs</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>ramfb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </video>
Nov 10 20:58:37 user nova-compute[75285]:     <hostdev supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='mode'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>subsystem</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='startupPolicy'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>default</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>mandatory</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>requisite</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>optional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='subsysType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pci</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='capsType'/>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='pciBackend'/>
Nov 10 20:58:37 user nova-compute[75285]:     </hostdev>
Nov 10 20:58:37 user nova-compute[75285]:     <rng supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>random</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egd</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>builtin</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </rng>
Nov 10 20:58:37 user nova-compute[75285]:     <filesystem supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='driverType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>path</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>handle</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtiofs</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </filesystem>
Nov 10 20:58:37 user nova-compute[75285]:     <tpm supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-tis</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-crb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>passthrough</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>emulator</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </tpm>
Nov 10 20:58:37 user nova-compute[75285]:   </devices>
Nov 10 20:58:37 user nova-compute[75285]:   <features>
Nov 10 20:58:37 user nova-compute[75285]:     <gic supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     <vmcoreinfo supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <genid supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backingStoreInput supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backup supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <sev supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:   </features>
Nov 10 20:58:37 user nova-compute[75285]: </domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:  {{(pid=75285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 10 20:58:37 user nova-compute[75285]: <domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 20:58:37 user nova-compute[75285]:   <domain>kvm</domain>
Nov 10 20:58:37 user nova-compute[75285]:   <machine>pc-q35-jammy</machine>
Nov 10 20:58:37 user nova-compute[75285]:   <arch>x86_64</arch>
Nov 10 20:58:37 user nova-compute[75285]:   <vcpu max='288'/>
Nov 10 20:58:37 user nova-compute[75285]:   <iothreads supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:   <os supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='firmware'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>efi</value>
Nov 10 20:58:37 user nova-compute[75285]:     </enum>
Nov 10 20:58:37 user nova-compute[75285]:     <loader supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>rom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pflash</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='readonly'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>yes</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='secure'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>yes</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </loader>
Nov 10 20:58:37 user nova-compute[75285]:   </os>
Nov 10 20:58:37 user nova-compute[75285]:   <cpu>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-passthrough' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='hostPassthroughMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>on</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='maximum' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='maximumMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>on</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-model' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <vendor>Intel</vendor>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ss'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='vmx'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='pcid'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='hypervisor'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arat'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='umip'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='md-clear'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='invtsc'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibpb'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibrs'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='rsba'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='erms'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='custom' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>qemu64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>qemu32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>phenom</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>n270</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>kvm64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>kvm32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>coreduo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>core2duo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>athlon</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Westmere</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Snowridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Penryn</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G5</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G4</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Opteron_G1</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Nehalem</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Rome</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Milan</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Dhyana</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cooperlake</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Conroe</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>486</model>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:   </cpu>
Nov 10 20:58:37 user nova-compute[75285]:   <memoryBacking supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='sourceType'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>file</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>anonymous</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>memfd</value>
Nov 10 20:58:37 user nova-compute[75285]:     </enum>
Nov 10 20:58:37 user nova-compute[75285]:   </memoryBacking>
Nov 10 20:58:37 user nova-compute[75285]:   <devices>
Nov 10 20:58:37 user nova-compute[75285]:     <disk supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='diskDevice'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>disk</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cdrom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>floppy</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>lun</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='bus'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>fdc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sata</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </disk>
Nov 10 20:58:37 user nova-compute[75285]:     <graphics supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sdl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vnc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>spice</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egl-headless</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </graphics>
Nov 10 20:58:37 user nova-compute[75285]:     <video supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='modelType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cirrus</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vmvga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>qxl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>none</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>bochs</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>ramfb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </video>
Nov 10 20:58:37 user nova-compute[75285]:     <hostdev supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='mode'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>subsystem</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='startupPolicy'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>default</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>mandatory</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>requisite</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>optional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='subsysType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pci</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='capsType'/>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='pciBackend'/>
Nov 10 20:58:37 user nova-compute[75285]:     </hostdev>
Nov 10 20:58:37 user nova-compute[75285]:     <rng supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>random</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egd</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>builtin</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </rng>
Nov 10 20:58:37 user nova-compute[75285]:     <filesystem supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='driverType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>path</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>handle</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtiofs</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </filesystem>
Nov 10 20:58:37 user nova-compute[75285]:     <tpm supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-tis</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-crb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>passthrough</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>emulator</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </tpm>
Nov 10 20:58:37 user nova-compute[75285]:   </devices>
Nov 10 20:58:37 user nova-compute[75285]:   <features>
Nov 10 20:58:37 user nova-compute[75285]:     <gic supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     <vmcoreinfo supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <genid supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backingStoreInput supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backup supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <sev supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:   </features>
Nov 10 20:58:37 user nova-compute[75285]: </domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:  {{(pid=75285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 10 20:58:37 user nova-compute[75285]: <domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 20:58:37 user nova-compute[75285]:   <domain>kvm</domain>
Nov 10 20:58:37 user nova-compute[75285]:   <machine>pc-q35-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:   <arch>x86_64</arch>
Nov 10 20:58:37 user nova-compute[75285]:   <vcpu max='288'/>
Nov 10 20:58:37 user nova-compute[75285]:   <iothreads supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:   <os supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='firmware'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>efi</value>
Nov 10 20:58:37 user nova-compute[75285]:     </enum>
Nov 10 20:58:37 user nova-compute[75285]:     <loader supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>rom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pflash</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='readonly'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>yes</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='secure'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>yes</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </loader>
Nov 10 20:58:37 user nova-compute[75285]:   </os>
Nov 10 20:58:37 user nova-compute[75285]:   <cpu>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-passthrough' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='hostPassthroughMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>on</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='maximum' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='maximumMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>on</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-model' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <vendor>Intel</vendor>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ss'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='vmx'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='pcid'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='hypervisor'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arat'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='umip'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='md-clear'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='invtsc'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibpb'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibrs'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='rsba'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='erms'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='custom' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>qemu64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>qemu32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>phenom</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>n270</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>kvm64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>kvm32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>coreduo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>core2duo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>athlon</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Westmere</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Snowridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Penryn</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G5</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G4</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Opteron_G1</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Nehalem</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Rome</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Milan</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Dhyana</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cooperlake</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Conroe</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>486</model>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:   </cpu>
Nov 10 20:58:37 user nova-compute[75285]:   <memoryBacking supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='sourceType'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>file</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>anonymous</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>memfd</value>
Nov 10 20:58:37 user nova-compute[75285]:     </enum>
Nov 10 20:58:37 user nova-compute[75285]:   </memoryBacking>
Nov 10 20:58:37 user nova-compute[75285]:   <devices>
Nov 10 20:58:37 user nova-compute[75285]:     <disk supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='diskDevice'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>disk</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cdrom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>floppy</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>lun</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='bus'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>fdc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sata</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </disk>
Nov 10 20:58:37 user nova-compute[75285]:     <graphics supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sdl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vnc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>spice</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egl-headless</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </graphics>
Nov 10 20:58:37 user nova-compute[75285]:     <video supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='modelType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cirrus</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vmvga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>qxl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>none</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>bochs</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>ramfb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </video>
Nov 10 20:58:37 user nova-compute[75285]:     <hostdev supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='mode'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>subsystem</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='startupPolicy'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>default</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>mandatory</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>requisite</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>optional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='subsysType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pci</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='capsType'/>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='pciBackend'/>
Nov 10 20:58:37 user nova-compute[75285]:     </hostdev>
Nov 10 20:58:37 user nova-compute[75285]:     <rng supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>random</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egd</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>builtin</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </rng>
Nov 10 20:58:37 user nova-compute[75285]:     <filesystem supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='driverType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>path</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>handle</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtiofs</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </filesystem>
Nov 10 20:58:37 user nova-compute[75285]:     <tpm supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-tis</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-crb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>passthrough</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>emulator</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </tpm>
Nov 10 20:58:37 user nova-compute[75285]:   </devices>
Nov 10 20:58:37 user nova-compute[75285]:   <features>
Nov 10 20:58:37 user nova-compute[75285]:     <gic supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     <vmcoreinfo supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <genid supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backingStoreInput supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backup supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <sev supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:   </features>
Nov 10 20:58:37 user nova-compute[75285]: </domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:  {{(pid=75285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 10 20:58:37 user nova-compute[75285]: <domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 20:58:37 user nova-compute[75285]:   <domain>kvm</domain>
Nov 10 20:58:37 user nova-compute[75285]:   <machine>pc-i440fx-6.2</machine>
Nov 10 20:58:37 user nova-compute[75285]:   <arch>x86_64</arch>
Nov 10 20:58:37 user nova-compute[75285]:   <vcpu max='255'/>
Nov 10 20:58:37 user nova-compute[75285]:   <iothreads supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:   <os supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='firmware'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>efi</value>
Nov 10 20:58:37 user nova-compute[75285]:     </enum>
Nov 10 20:58:37 user nova-compute[75285]:     <loader supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>rom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pflash</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='readonly'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>yes</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='secure'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>no</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </loader>
Nov 10 20:58:37 user nova-compute[75285]:   </os>
Nov 10 20:58:37 user nova-compute[75285]:   <cpu>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-passthrough' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='hostPassthroughMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>on</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='maximum' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='maximumMigratable'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>on</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>off</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='host-model' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <vendor>Intel</vendor>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ss'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='vmx'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='pcid'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='hypervisor'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arat'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='umip'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='md-clear'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='invtsc'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibpb'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='ibrs'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-stibp'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='rsba'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='erms'/>
Nov 10 20:58:37 user nova-compute[75285]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:     <mode name='custom' supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>qemu64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>qemu32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>phenom</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>pentium</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>n270</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>kvm64</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>kvm32</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>coreduo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>core2duo</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>athlon</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Westmere</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Snowridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Skylake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>SandyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Penryn</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G5</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G4</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G3</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Opteron_G2</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Opteron_G1</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Nehalem</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>IvyBridge</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Icelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Haswell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Rome</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-Milan</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>EPYC</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Dhyana</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cooperlake</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>Conroe</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='no'>Broadwell</model>
Nov 10 20:58:37 user nova-compute[75285]:       <model usable='yes'>486</model>
Nov 10 20:58:37 user nova-compute[75285]:     </mode>
Nov 10 20:58:37 user nova-compute[75285]:   </cpu>
Nov 10 20:58:37 user nova-compute[75285]:   <memoryBacking supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:     <enum name='sourceType'>
Nov 10 20:58:37 user nova-compute[75285]:       <value>file</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>anonymous</value>
Nov 10 20:58:37 user nova-compute[75285]:       <value>memfd</value>
Nov 10 20:58:37 user nova-compute[75285]:     </enum>
Nov 10 20:58:37 user nova-compute[75285]:   </memoryBacking>
Nov 10 20:58:37 user nova-compute[75285]:   <devices>
Nov 10 20:58:37 user nova-compute[75285]:     <disk supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='diskDevice'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>disk</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cdrom</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>floppy</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>lun</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='bus'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>ide</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>fdc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sata</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </disk>
Nov 10 20:58:37 user nova-compute[75285]:     <graphics supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='type'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>sdl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vnc</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>spice</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egl-headless</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </graphics>
Nov 10 20:58:37 user nova-compute[75285]:     <video supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='modelType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>cirrus</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>vmvga</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>qxl</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>none</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>bochs</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>ramfb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </video>
Nov 10 20:58:37 user nova-compute[75285]:     <hostdev supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='mode'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>subsystem</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='startupPolicy'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>default</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>mandatory</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>requisite</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>optional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='subsysType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>usb</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>pci</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>scsi</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='capsType'/>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='pciBackend'/>
Nov 10 20:58:37 user nova-compute[75285]:     </hostdev>
Nov 10 20:58:37 user nova-compute[75285]:     <rng supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtio-non-transitional</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>random</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>egd</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>builtin</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </rng>
Nov 10 20:58:37 user nova-compute[75285]:     <filesystem supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='driverType'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>path</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>handle</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>virtiofs</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </filesystem>
Nov 10 20:58:37 user nova-compute[75285]:     <tpm supported='yes'>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='model'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-tis</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>tpm-crb</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:       <enum name='backendModel'>
Nov 10 20:58:37 user nova-compute[75285]:         <value>passthrough</value>
Nov 10 20:58:37 user nova-compute[75285]:         <value>emulator</value>
Nov 10 20:58:37 user nova-compute[75285]:       </enum>
Nov 10 20:58:37 user nova-compute[75285]:     </tpm>
Nov 10 20:58:37 user nova-compute[75285]:   </devices>
Nov 10 20:58:37 user nova-compute[75285]:   <features>
Nov 10 20:58:37 user nova-compute[75285]:     <gic supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:     <vmcoreinfo supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <genid supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backingStoreInput supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <backup supported='yes'/>
Nov 10 20:58:37 user nova-compute[75285]:     <sev supported='no'/>
Nov 10 20:58:37 user nova-compute[75285]:   </features>
Nov 10 20:58:37 user nova-compute[75285]: </domainCapabilities>
Nov 10 20:58:37 user nova-compute[75285]:  {{(pid=75285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Checking secure boot support for host arch (x86_64) {{(pid=75285) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Checking secure boot support for host arch (x86_64) {{(pid=75285) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Checking secure boot support for host arch (x86_64) {{(pid=75285) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 20:58:37 user nova-compute[75285]: INFO nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Secure Boot support detected
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] cpu compare xml: <cpu match="exact">
Nov 10 20:58:37 user nova-compute[75285]:   <model>Nehalem</model>
Nov 10 20:58:37 user nova-compute[75285]: </cpu>
Nov 10 20:58:37 user nova-compute[75285]:  {{(pid=75285) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 10 20:58:37 user nova-compute[75285]: INFO nova.virt.node [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Generated node identity ec9ffc90-0859-4ab9-a65f-7415028d9d13
Nov 10 20:58:37 user nova-compute[75285]: INFO nova.virt.node [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Wrote node identity ec9ffc90-0859-4ab9-a65f-7415028d9d13 to /opt/stack/data/nova/compute_id
Nov 10 20:58:37 user nova-compute[75285]: WARNING nova.compute.manager [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Compute nodes ['ec9ffc90-0859-4ab9-a65f-7415028d9d13'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 10 20:58:37 user nova-compute[75285]: INFO nova.compute.manager [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 10 20:58:37 user nova-compute[75285]: WARNING nova.compute.manager [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 20:58:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:58:37 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:58:38 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:58:38 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Hypervisor/Node resource view: name=user free_ram=10941MB free_disk=26.091800689697266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:58:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:58:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:58:38 user nova-compute[75285]: WARNING nova.compute.resource_tracker [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] No compute node record for user:ec9ffc90-0859-4ab9-a65f-7415028d9d13: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host ec9ffc90-0859-4ab9-a65f-7415028d9d13 could not be found.
Nov 10 20:58:38 user nova-compute[75285]: INFO nova.compute.resource_tracker [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Compute node record created for user:user with uuid: ec9ffc90-0859-4ab9-a65f-7415028d9d13
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:58:38 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] [req-5688c13c-4081-4276-8f43-61fb38049dca] Created resource provider record via placement API for resource provider with UUID ec9ffc90-0859-4ab9-a65f-7415028d9d13 and name user.
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75285) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 10 20:58:38 user nova-compute[75285]: INFO nova.virt.libvirt.host [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] kernel doesn't support AMD SEV
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Updating inventory in ProviderTree for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Libvirt baseline CPU <cpu>
Nov 10 20:58:38 user nova-compute[75285]:   <arch>x86_64</arch>
Nov 10 20:58:38 user nova-compute[75285]:   <model>Nehalem</model>
Nov 10 20:58:38 user nova-compute[75285]:   <vendor>Intel</vendor>
Nov 10 20:58:38 user nova-compute[75285]:   <topology sockets="6" cores="1" threads="1"/>
Nov 10 20:58:38 user nova-compute[75285]: </cpu>
Nov 10 20:58:38 user nova-compute[75285]:  {{(pid=75285) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Updated inventory for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Updating resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 generation from 0 to 1 during operation: update_inventory {{(pid=75285) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Updating inventory in ProviderTree for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Updating resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 generation from 1 to 2 during operation: update_traits {{(pid=75285) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:58:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.655s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.service [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Creating RPC server for service compute {{(pid=75285) start /opt/stack/nova/nova/service.py:182}}
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.service [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] Join ServiceGroup membership for this service compute {{(pid=75285) start /opt/stack/nova/nova/service.py:199}}
Nov 10 20:58:38 user nova-compute[75285]: DEBUG nova.servicegroup.drivers.db [None req-5b4db517-dede-4b7a-ada3-5b5564a0baf1 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75285) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 10 20:58:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_power_states {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:58:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Didn't find any instances for network info cache update. {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 20:59:29 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:59:29 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 20:59:29 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=10390MB free_disk=25.995635986328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 20:59:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 20:59:30 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 20:59:30 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 20:59:30 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 20:59:30 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 20:59:30 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 20:59:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:00:30 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:00:30 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:00:30 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=10288MB free_disk=26.059917449951172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:00:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:00:31 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:00:31 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:00:31 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:00:31 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:00:31 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:00:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:00:32 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:00:32 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:00:32 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:00:32 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Didn't find any instances for network info cache update. {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 21:01:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:01:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:01:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:01:30 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:01:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:01:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:01:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:01:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:01:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:01:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:01:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:01:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:01:31 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:01:31 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:01:31 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:01:31 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=10339MB free_disk=25.81238555908203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:01:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:01:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:01:31 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:01:31 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:01:32 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:01:32 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:01:32 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:01:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:01:33 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:01:33 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:01:33 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:01:33 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Didn't find any instances for network info cache update. {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 21:02:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:02:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:02:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:02:30 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:02:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:02:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:02:32 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:02:32 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:02:33 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:02:33 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:02:33 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:02:33 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Didn't find any instances for network info cache update. {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 21:02:33 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:02:33 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:02:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:33 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:02:34 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:02:34 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:02:34 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=9609MB free_disk=25.832202911376953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:02:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:34 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:02:34 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:02:34 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:02:34 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:02:34 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:02:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:02:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:38 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:02:38 user nova-compute[75285]: INFO nova.compute.claims [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Claim successful on node user
Nov 10 21:02:39 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:02:39 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:02:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Acquiring lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:02:39 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Creating image(s)
Nov 10 21:02:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "/opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "/opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "/opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "62e8cc12-802e-415c-a166-4590715372c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "62e8cc12-802e-415c-a166-4590715372c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:02:39 user nova-compute[75285]: INFO nova.compute.claims [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Claim successful on node user
Nov 10 21:02:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG nova.policy [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9c20460877a428e9fa97869ba34eb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44979c0f5b7d4205a0e5e0becbe714cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:02:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:40 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:02:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1.part --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:40 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:02:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.974s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:40 user nova-compute[75285]: DEBUG nova.compute.manager [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:02:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.812s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:40 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:02:40 user nova-compute[75285]: INFO nova.compute.claims [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Claim successful on node user
Nov 10 21:02:40 user nova-compute[75285]: DEBUG nova.compute.manager [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:02:40 user nova-compute[75285]: DEBUG nova.network.neutron [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:02:40 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:02:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1.part --force-share --output=json" returned: 0 in 0.222s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:40 user nova-compute[75285]: DEBUG nova.virt.images [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] e00023c7-f7f3-49f2-b464-c809b7ab7608 was qcow2, converting to raw {{(pid=75285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 21:02:40 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:02:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1.part /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1.converted {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:40 user nova-compute[75285]: DEBUG nova.compute.manager [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1.part /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1.converted" returned: 0 in 0.283s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1.converted --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:02:41 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Creating image(s)
Nov 10 21:02:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Acquiring lock "/opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "/opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "/opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG nova.policy [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d6b0511ba054bf78ede21b9db18fe59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d223d68b26463c93d4c8f203d5d597', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.671s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:41 user nova-compute[75285]: INFO oslo.privsep.daemon [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpp14jl47t/privsep.sock']
Nov 10 21:02:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.161s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:41 user sudo[84540]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpp14jl47t/privsep.sock
Nov 10 21:02:41 user sudo[84540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 21:02:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:02:41 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:02:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:02:41 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Creating image(s)
Nov 10 21:02:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "/opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "/opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "/opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:41 user nova-compute[75285]: DEBUG nova.policy [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9c20460877a428e9fa97869ba34eb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44979c0f5b7d4205a0e5e0becbe714cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:02:42 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Successfully created port: 9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:02:43 user sudo[84540]: pam_unix(sudo:session): session closed for user root
Nov 10 21:02:43 user nova-compute[75285]: INFO oslo.privsep.daemon [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Spawned new privsep daemon via rootwrap
Nov 10 21:02:43 user nova-compute[75285]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 21:02:43 user nova-compute[75285]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 21:02:43 user nova-compute[75285]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 10 21:02:43 user nova-compute[75285]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84544
Nov 10 21:02:43 user nova-compute[75285]: WARNING oslo_privsep.priv_context [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] privsep daemon already running
Nov 10 21:02:43 user nova-compute[75285]: WARNING oslo_privsep.priv_context [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] privsep daemon already running
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.171s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.193s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG nova.network.neutron [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Successfully created port: 86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk 1073741824" returned: 0 in 0.052s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.227s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.207s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.271s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk 1073741824" returned: 0 in 0.046s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.570s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Cannot resize image /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Ensure instance console log exists: /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Successfully created port: 87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.171s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.240s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk 1073741824" returned: 0 in 0.069s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Cannot resize image /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Ensure instance console log exists: /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.238s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Successfully updated port: 9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquired lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Cannot resize image /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Ensure instance console log exists: /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:44 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:02:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-9773a435-e2bf-4a7b-9d1a-e3ed3745b844 req-f3c27831-7263-4c48-b045-ce5f737f2984 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-changed-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:02:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-9773a435-e2bf-4a7b-9d1a-e3ed3745b844 req-f3c27831-7263-4c48-b045-ce5f737f2984 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Refreshing instance network info cache due to event network-changed-9a01ec6d-d090-40da-bdbf-5bb60b90157e. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:02:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9773a435-e2bf-4a7b-9d1a-e3ed3745b844 req-f3c27831-7263-4c48-b045-ce5f737f2984 service nova] Acquiring lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Updating instance_info_cache with network_info: [{"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Releasing lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Instance network_info: |[{"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9773a435-e2bf-4a7b-9d1a-e3ed3745b844 req-f3c27831-7263-4c48-b045-ce5f737f2984 service nova] Acquired lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.network.neutron [req-9773a435-e2bf-4a7b-9d1a-e3ed3745b844 req-f3c27831-7263-4c48-b045-ce5f737f2984 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Refreshing network info cache for port 9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Start _get_guest_xml network_info=[{"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:02:46 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:02:46 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1516474923',display_name='tempest-ServerRescueNegativeTestJSON-server-1516474923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1516474923',id=1,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44979c0f5b7d4205a0e5e0becbe714cb',ramdisk_id='',reservation_id='r-myu73inz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-418662944',owner_user_name='tempest-ServerRescueNegativeTestJSON-418662944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:02:40Z,user_data=None,user_id='b9c20460877a428e9fa97869ba34eb04',uuid=16f56b6b-f08d-4650-b0eb-a202662b0eb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converting VIF {"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=9a01ec6d-d090-40da-bdbf-5bb60b90157e,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a01ec6d-d0') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'pci_devices' on Instance uuid 16f56b6b-f08d-4650-b0eb-a202662b0eb6 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.network.neutron [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Successfully updated port: 86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Acquiring lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Acquired lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.network.neutron [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:02:46 user nova-compute[75285]:   <uuid>16f56b6b-f08d-4650-b0eb-a202662b0eb6</uuid>
Nov 10 21:02:46 user nova-compute[75285]:   <name>instance-00000001</name>
Nov 10 21:02:46 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:02:46 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:02:46 user nova-compute[75285]:   <metadata>
Nov 10 21:02:46 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:02:46 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:02:46 user nova-compute[75285]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1516474923</nova:name>
Nov 10 21:02:46 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:02:46</nova:creationTime>
Nov 10 21:02:46 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:02:46 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:02:46 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:02:46 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:02:46 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:02:46 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:02:46 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:02:46 user nova-compute[75285]:       <nova:owner>
Nov 10 21:02:46 user nova-compute[75285]:         <nova:user uuid="b9c20460877a428e9fa97869ba34eb04">tempest-ServerRescueNegativeTestJSON-418662944-project-member</nova:user>
Nov 10 21:02:46 user nova-compute[75285]:         <nova:project uuid="44979c0f5b7d4205a0e5e0becbe714cb">tempest-ServerRescueNegativeTestJSON-418662944</nova:project>
Nov 10 21:02:46 user nova-compute[75285]:       </nova:owner>
Nov 10 21:02:46 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:02:46 user nova-compute[75285]:       <nova:ports>
Nov 10 21:02:46 user nova-compute[75285]:         <nova:port uuid="9a01ec6d-d090-40da-bdbf-5bb60b90157e">
Nov 10 21:02:46 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 21:02:46 user nova-compute[75285]:         </nova:port>
Nov 10 21:02:46 user nova-compute[75285]:       </nova:ports>
Nov 10 21:02:46 user nova-compute[75285]:     </nova:instance>
Nov 10 21:02:46 user nova-compute[75285]:   </metadata>
Nov 10 21:02:46 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:02:46 user nova-compute[75285]:     <system>
Nov 10 21:02:46 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:02:46 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:02:46 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:02:46 user nova-compute[75285]:       <entry name="serial">16f56b6b-f08d-4650-b0eb-a202662b0eb6</entry>
Nov 10 21:02:46 user nova-compute[75285]:       <entry name="uuid">16f56b6b-f08d-4650-b0eb-a202662b0eb6</entry>
Nov 10 21:02:46 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:02:46 user nova-compute[75285]:     </system>
Nov 10 21:02:46 user nova-compute[75285]:   </sysinfo>
Nov 10 21:02:46 user nova-compute[75285]:   <os>
Nov 10 21:02:46 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:02:46 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:02:46 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:02:46 user nova-compute[75285]:   </os>
Nov 10 21:02:46 user nova-compute[75285]:   <features>
Nov 10 21:02:46 user nova-compute[75285]:     <acpi/>
Nov 10 21:02:46 user nova-compute[75285]:     <apic/>
Nov 10 21:02:46 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:02:46 user nova-compute[75285]:   </features>
Nov 10 21:02:46 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:02:46 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:02:46 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:02:46 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:02:46 user nova-compute[75285]:   </clock>
Nov 10 21:02:46 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:02:46 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:02:46 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:02:46 user nova-compute[75285]:   </cpu>
Nov 10 21:02:46 user nova-compute[75285]:   <devices>
Nov 10 21:02:46 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:02:46 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:02:46 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk"/>
Nov 10 21:02:46 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:02:46 user nova-compute[75285]:     </disk>
Nov 10 21:02:46 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:02:46 user nova-compute[75285]:       <mac address="fa:16:3e:e9:4b:33"/>
Nov 10 21:02:46 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:02:46 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:02:46 user nova-compute[75285]:       <target dev="tap9a01ec6d-d0"/>
Nov 10 21:02:46 user nova-compute[75285]:     </interface>
Nov 10 21:02:46 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:02:46 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/console.log" append="off"/>
Nov 10 21:02:46 user nova-compute[75285]:     </serial>
Nov 10 21:02:46 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:02:46 user nova-compute[75285]:     <video>
Nov 10 21:02:46 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:02:46 user nova-compute[75285]:     </video>
Nov 10 21:02:46 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:02:46 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:02:46 user nova-compute[75285]:     </rng>
Nov 10 21:02:46 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:02:46 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:02:46 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:02:46 user nova-compute[75285]:     </memballoon>
Nov 10 21:02:46 user nova-compute[75285]:   </devices>
Nov 10 21:02:46 user nova-compute[75285]: </domain>
Nov 10 21:02:46 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1516474923',display_name='tempest-ServerRescueNegativeTestJSON-server-1516474923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1516474923',id=1,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44979c0f5b7d4205a0e5e0becbe714cb',ramdisk_id='',reservation_id='r-myu73inz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-418662944',owner_user_name='tempest-ServerRescueNegativeTestJSON-418662944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:02:40Z,user_data=None,user_id='b9c20460877a428e9fa97869ba34eb04',uuid=16f56b6b-f08d-4650-b0eb-a202662b0eb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converting VIF {"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=9a01ec6d-d090-40da-bdbf-5bb60b90157e,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a01ec6d-d0') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG os_vif [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=9a01ec6d-d090-40da-bdbf-5bb60b90157e,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a01ec6d-d0') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Created schema index Interface.name {{(pid=75285) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Created schema index Port.name {{(pid=75285) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Created schema index Bridge.name {{(pid=75285) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [POLLOUT] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '504936c9-21b3-5dbe-bf4b-fa0b099b29c6', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:46 user nova-compute[75285]: INFO oslo.privsep.daemon [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpykov6vm4/privsep.sock']
Nov 10 21:02:46 user sudo[84596]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpykov6vm4/privsep.sock
Nov 10 21:02:46 user sudo[84596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.network.neutron [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Successfully updated port: 87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquired lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:02:46 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:02:47 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:02:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-9d99f661-3dba-4089-81cf-42c61defe5c2 req-d171c503-a7a7-4e5e-a337-6c250a96e659 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received event network-changed-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:02:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-9d99f661-3dba-4089-81cf-42c61defe5c2 req-d171c503-a7a7-4e5e-a337-6c250a96e659 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Refreshing instance network info cache due to event network-changed-87b7f663-4936-4a68-b667-7097b5b46783. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:02:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9d99f661-3dba-4089-81cf-42c61defe5c2 req-d171c503-a7a7-4e5e-a337-6c250a96e659 service nova] Acquiring lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:02:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-d2ac17e9-b5f9-4520-a6bb-9d815ca30577 req-4d217069-c805-4292-87bd-a01da1517149 service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Received event network-changed-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:02:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-d2ac17e9-b5f9-4520-a6bb-9d815ca30577 req-4d217069-c805-4292-87bd-a01da1517149 service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Refreshing instance network info cache due to event network-changed-86d6abc5-af6c-4a7a-be0c-81dc149b5df7. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:02:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d2ac17e9-b5f9-4520-a6bb-9d815ca30577 req-4d217069-c805-4292-87bd-a01da1517149 service nova] Acquiring lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user sudo[84596]: pam_unix(sudo:session): session closed for user root
Nov 10 21:02:48 user nova-compute[75285]: INFO oslo.privsep.daemon [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Spawned new privsep daemon via rootwrap
Nov 10 21:02:48 user nova-compute[75285]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 21:02:48 user nova-compute[75285]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 21:02:48 user nova-compute[75285]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 10 21:02:48 user nova-compute[75285]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84600
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Updating instance_info_cache with network_info: [{"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Releasing lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Instance network_info: |[{"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9d99f661-3dba-4089-81cf-42c61defe5c2 req-d171c503-a7a7-4e5e-a337-6c250a96e659 service nova] Acquired lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.network.neutron [req-9d99f661-3dba-4089-81cf-42c61defe5c2 req-d171c503-a7a7-4e5e-a337-6c250a96e659 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Refreshing network info cache for port 87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Start _get_guest_xml network_info=[{"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:02:48 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:02:48 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1706581524',display_name='tempest-ServerRescueNegativeTestJSON-server-1706581524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1706581524',id=3,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44979c0f5b7d4205a0e5e0becbe714cb',ramdisk_id='',reservation_id='r-ybxi4o1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-418662944',owner_user_name='tempest-ServerRescueNegativeTestJSON-418662944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:02:42Z,user_data=None,user_id='b9c20460877a428e9fa97869ba34eb04',uuid=62e8cc12-802e-415c-a166-4590715372c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converting VIF {"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:43,bridge_name='br-int',has_traffic_filtering=True,id=87b7f663-4936-4a68-b667-7097b5b46783,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b7f663-49') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'pci_devices' on Instance uuid 62e8cc12-802e-415c-a166-4590715372c5 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.network.neutron [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Updating instance_info_cache with network_info: [{"id": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "address": "fa:16:3e:d6:59:09", "network": {"id": "bb78092d-2ba8-42bd-862e-b697ef77a6ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958013330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d223d68b26463c93d4c8f203d5d597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d6abc5-af", "ovs_interfaceid": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:02:48 user nova-compute[75285]:   <uuid>62e8cc12-802e-415c-a166-4590715372c5</uuid>
Nov 10 21:02:48 user nova-compute[75285]:   <name>instance-00000003</name>
Nov 10 21:02:48 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:02:48 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:02:48 user nova-compute[75285]:   <metadata>
Nov 10 21:02:48 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:02:48 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:02:48 user nova-compute[75285]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1706581524</nova:name>
Nov 10 21:02:48 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:02:48</nova:creationTime>
Nov 10 21:02:48 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:02:48 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:02:48 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:02:48 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:02:48 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:02:48 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:02:48 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:02:48 user nova-compute[75285]:       <nova:owner>
Nov 10 21:02:48 user nova-compute[75285]:         <nova:user uuid="b9c20460877a428e9fa97869ba34eb04">tempest-ServerRescueNegativeTestJSON-418662944-project-member</nova:user>
Nov 10 21:02:48 user nova-compute[75285]:         <nova:project uuid="44979c0f5b7d4205a0e5e0becbe714cb">tempest-ServerRescueNegativeTestJSON-418662944</nova:project>
Nov 10 21:02:48 user nova-compute[75285]:       </nova:owner>
Nov 10 21:02:48 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:02:48 user nova-compute[75285]:       <nova:ports>
Nov 10 21:02:48 user nova-compute[75285]:         <nova:port uuid="87b7f663-4936-4a68-b667-7097b5b46783">
Nov 10 21:02:48 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 21:02:48 user nova-compute[75285]:         </nova:port>
Nov 10 21:02:48 user nova-compute[75285]:       </nova:ports>
Nov 10 21:02:48 user nova-compute[75285]:     </nova:instance>
Nov 10 21:02:48 user nova-compute[75285]:   </metadata>
Nov 10 21:02:48 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:02:48 user nova-compute[75285]:     <system>
Nov 10 21:02:48 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:02:48 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:02:48 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:02:48 user nova-compute[75285]:       <entry name="serial">62e8cc12-802e-415c-a166-4590715372c5</entry>
Nov 10 21:02:48 user nova-compute[75285]:       <entry name="uuid">62e8cc12-802e-415c-a166-4590715372c5</entry>
Nov 10 21:02:48 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:02:48 user nova-compute[75285]:     </system>
Nov 10 21:02:48 user nova-compute[75285]:   </sysinfo>
Nov 10 21:02:48 user nova-compute[75285]:   <os>
Nov 10 21:02:48 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:02:48 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:02:48 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:02:48 user nova-compute[75285]:   </os>
Nov 10 21:02:48 user nova-compute[75285]:   <features>
Nov 10 21:02:48 user nova-compute[75285]:     <acpi/>
Nov 10 21:02:48 user nova-compute[75285]:     <apic/>
Nov 10 21:02:48 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:02:48 user nova-compute[75285]:   </features>
Nov 10 21:02:48 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:02:48 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:02:48 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:02:48 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:02:48 user nova-compute[75285]:   </clock>
Nov 10 21:02:48 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:02:48 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:02:48 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:02:48 user nova-compute[75285]:   </cpu>
Nov 10 21:02:48 user nova-compute[75285]:   <devices>
Nov 10 21:02:48 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:02:48 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:02:48 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk"/>
Nov 10 21:02:48 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:02:48 user nova-compute[75285]:     </disk>
Nov 10 21:02:48 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:02:48 user nova-compute[75285]:       <mac address="fa:16:3e:32:86:43"/>
Nov 10 21:02:48 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:02:48 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:02:48 user nova-compute[75285]:       <target dev="tap87b7f663-49"/>
Nov 10 21:02:48 user nova-compute[75285]:     </interface>
Nov 10 21:02:48 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:02:48 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/console.log" append="off"/>
Nov 10 21:02:48 user nova-compute[75285]:     </serial>
Nov 10 21:02:48 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:02:48 user nova-compute[75285]:     <video>
Nov 10 21:02:48 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:02:48 user nova-compute[75285]:     </video>
Nov 10 21:02:48 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:02:48 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:02:48 user nova-compute[75285]:     </rng>
Nov 10 21:02:48 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:02:48 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:02:48 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:02:48 user nova-compute[75285]:     </memballoon>
Nov 10 21:02:48 user nova-compute[75285]:   </devices>
Nov 10 21:02:48 user nova-compute[75285]: </domain>
Nov 10 21:02:48 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1706581524',display_name='tempest-ServerRescueNegativeTestJSON-server-1706581524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1706581524',id=3,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44979c0f5b7d4205a0e5e0becbe714cb',ramdisk_id='',reservation_id='r-ybxi4o1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-418662944',owner_user_name='tempest-ServerRescueNegativeTestJSON-418662944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:02:42Z,user_data=None,user_id='b9c20460877a428e9fa97869ba34eb04',uuid=62e8cc12-802e-415c-a166-4590715372c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converting VIF {"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:43,bridge_name='br-int',has_traffic_filtering=True,id=87b7f663-4936-4a68-b667-7097b5b46783,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b7f663-49') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG os_vif [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:43,bridge_name='br-int',has_traffic_filtering=True,id=87b7f663-4936-4a68-b667-7097b5b46783,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b7f663-49') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2f53b17-ec39-5023-b8e3-bb5ecbb47c97', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Releasing lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.compute.manager [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Instance network_info: |[{"id": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "address": "fa:16:3e:d6:59:09", "network": {"id": "bb78092d-2ba8-42bd-862e-b697ef77a6ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958013330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d223d68b26463c93d4c8f203d5d597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d6abc5-af", "ovs_interfaceid": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d2ac17e9-b5f9-4520-a6bb-9d815ca30577 req-4d217069-c805-4292-87bd-a01da1517149 service nova] Acquired lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.network.neutron [req-d2ac17e9-b5f9-4520-a6bb-9d815ca30577 req-4d217069-c805-4292-87bd-a01da1517149 service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Refreshing network info cache for port 86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Start _get_guest_xml network_info=[{"id": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "address": "fa:16:3e:d6:59:09", "network": {"id": "bb78092d-2ba8-42bd-862e-b697ef77a6ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958013330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d223d68b26463c93d4c8f203d5d597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d6abc5-af", "ovs_interfaceid": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:02:48 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:02:48 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1042147122',display_name='tempest-ServerActionsTestOtherB-server-1042147122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1042147122',id=2,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHSVfWesCMN5U0w8FiBJhlrIgDuGfvpAydqXhPieWhctFEpGK1NUW04H0/zt6WHWlNh6c7ZSz2jhTT2OSBgKo9hTQDXn8yOjvrqcXJwcfzTMnYILFq9HCXRp4fxPC2pag==',key_name='tempest-keypair-2111708737',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d223d68b26463c93d4c8f203d5d597',ramdisk_id='',reservation_id='r-o17p00dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-216766959',owner_user_name='tempest-ServerActionsTestOtherB-216766959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6b0511ba054bf78ede21b9db18fe59',uuid=02b4446d-1538-4e80-b93d-5cb904b7b98f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "address": "fa:16:3e:d6:59:09", "network": {"id": "bb78092d-2ba8-42bd-862e-b697ef77a6ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958013330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d223d68b26463c93d4c8f203d5d597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d6abc5-af", "ovs_interfaceid": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Converting VIF {"id": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "address": "fa:16:3e:d6:59:09", "network": {"id": "bb78092d-2ba8-42bd-862e-b697ef77a6ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958013330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d223d68b26463c93d4c8f203d5d597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d6abc5-af", "ovs_interfaceid": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:59:09,bridge_name='br-int',has_traffic_filtering=True,id=86d6abc5-af6c-4a7a-be0c-81dc149b5df7,network=Network(bb78092d-2ba8-42bd-862e-b697ef77a6ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d6abc5-af') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.objects.instance [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lazy-loading 'pci_devices' on Instance uuid 02b4446d-1538-4e80-b93d-5cb904b7b98f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:02:48 user nova-compute[75285]:   <uuid>02b4446d-1538-4e80-b93d-5cb904b7b98f</uuid>
Nov 10 21:02:48 user nova-compute[75285]:   <name>instance-00000002</name>
Nov 10 21:02:48 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:02:48 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:02:48 user nova-compute[75285]:   <metadata>
Nov 10 21:02:48 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:02:48 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:02:48 user nova-compute[75285]:       <nova:name>tempest-ServerActionsTestOtherB-server-1042147122</nova:name>
Nov 10 21:02:48 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:02:48</nova:creationTime>
Nov 10 21:02:48 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:02:48 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:02:48 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:02:48 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:02:48 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:02:48 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:02:48 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:02:48 user nova-compute[75285]:       <nova:owner>
Nov 10 21:02:48 user nova-compute[75285]:         <nova:user uuid="9d6b0511ba054bf78ede21b9db18fe59">tempest-ServerActionsTestOtherB-216766959-project-member</nova:user>
Nov 10 21:02:48 user nova-compute[75285]:         <nova:project uuid="11d223d68b26463c93d4c8f203d5d597">tempest-ServerActionsTestOtherB-216766959</nova:project>
Nov 10 21:02:48 user nova-compute[75285]:       </nova:owner>
Nov 10 21:02:48 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:02:48 user nova-compute[75285]:       <nova:ports>
Nov 10 21:02:48 user nova-compute[75285]:         <nova:port uuid="86d6abc5-af6c-4a7a-be0c-81dc149b5df7">
Nov 10 21:02:48 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 21:02:48 user nova-compute[75285]:         </nova:port>
Nov 10 21:02:48 user nova-compute[75285]:       </nova:ports>
Nov 10 21:02:48 user nova-compute[75285]:     </nova:instance>
Nov 10 21:02:48 user nova-compute[75285]:   </metadata>
Nov 10 21:02:48 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:02:48 user nova-compute[75285]:     <system>
Nov 10 21:02:48 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:02:48 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:02:48 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:02:48 user nova-compute[75285]:       <entry name="serial">02b4446d-1538-4e80-b93d-5cb904b7b98f</entry>
Nov 10 21:02:48 user nova-compute[75285]:       <entry name="uuid">02b4446d-1538-4e80-b93d-5cb904b7b98f</entry>
Nov 10 21:02:48 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:02:48 user nova-compute[75285]:     </system>
Nov 10 21:02:48 user nova-compute[75285]:   </sysinfo>
Nov 10 21:02:48 user nova-compute[75285]:   <os>
Nov 10 21:02:48 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:02:48 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:02:48 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:02:48 user nova-compute[75285]:   </os>
Nov 10 21:02:48 user nova-compute[75285]:   <features>
Nov 10 21:02:48 user nova-compute[75285]:     <acpi/>
Nov 10 21:02:48 user nova-compute[75285]:     <apic/>
Nov 10 21:02:48 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:02:48 user nova-compute[75285]:   </features>
Nov 10 21:02:48 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:02:48 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:02:48 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:02:48 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:02:48 user nova-compute[75285]:   </clock>
Nov 10 21:02:48 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:02:48 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:02:48 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:02:48 user nova-compute[75285]:   </cpu>
Nov 10 21:02:48 user nova-compute[75285]:   <devices>
Nov 10 21:02:48 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:02:48 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:02:48 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk"/>
Nov 10 21:02:48 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:02:48 user nova-compute[75285]:     </disk>
Nov 10 21:02:48 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:02:48 user nova-compute[75285]:       <mac address="fa:16:3e:d6:59:09"/>
Nov 10 21:02:48 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:02:48 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:02:48 user nova-compute[75285]:       <target dev="tap86d6abc5-af"/>
Nov 10 21:02:48 user nova-compute[75285]:     </interface>
Nov 10 21:02:48 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:02:48 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/console.log" append="off"/>
Nov 10 21:02:48 user nova-compute[75285]:     </serial>
Nov 10 21:02:48 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:02:48 user nova-compute[75285]:     <video>
Nov 10 21:02:48 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:02:48 user nova-compute[75285]:     </video>
Nov 10 21:02:48 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:02:48 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:02:48 user nova-compute[75285]:     </rng>
Nov 10 21:02:48 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:02:48 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:02:48 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:02:48 user nova-compute[75285]:     </memballoon>
Nov 10 21:02:48 user nova-compute[75285]:   </devices>
Nov 10 21:02:48 user nova-compute[75285]: </domain>
Nov 10 21:02:48 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1042147122',display_name='tempest-ServerActionsTestOtherB-server-1042147122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1042147122',id=2,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHSVfWesCMN5U0w8FiBJhlrIgDuGfvpAydqXhPieWhctFEpGK1NUW04H0/zt6WHWlNh6c7ZSz2jhTT2OSBgKo9hTQDXn8yOjvrqcXJwcfzTMnYILFq9HCXRp4fxPC2pag==',key_name='tempest-keypair-2111708737',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11d223d68b26463c93d4c8f203d5d597',ramdisk_id='',reservation_id='r-o17p00dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-216766959',owner_user_name='tempest-ServerActionsTestOtherB-216766959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6b0511ba054bf78ede21b9db18fe59',uuid=02b4446d-1538-4e80-b93d-5cb904b7b98f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "address": "fa:16:3e:d6:59:09", "network": {"id": "bb78092d-2ba8-42bd-862e-b697ef77a6ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958013330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d223d68b26463c93d4c8f203d5d597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d6abc5-af", "ovs_interfaceid": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Converting VIF {"id": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "address": "fa:16:3e:d6:59:09", "network": {"id": "bb78092d-2ba8-42bd-862e-b697ef77a6ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958013330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d223d68b26463c93d4c8f203d5d597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d6abc5-af", "ovs_interfaceid": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:59:09,bridge_name='br-int',has_traffic_filtering=True,id=86d6abc5-af6c-4a7a-be0c-81dc149b5df7,network=Network(bb78092d-2ba8-42bd-862e-b697ef77a6ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d6abc5-af') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG os_vif [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:59:09,bridge_name='br-int',has_traffic_filtering=True,id=86d6abc5-af6c-4a7a-be0c-81dc149b5df7,network=Network(bb78092d-2ba8-42bd-862e-b697ef77a6ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d6abc5-af') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85149fdb-00c9-5446-9257-404b02208217', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.network.neutron [req-9773a435-e2bf-4a7b-9d1a-e3ed3745b844 req-f3c27831-7263-4c48-b045-ce5f737f2984 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Updated VIF entry in instance network info cache for port 9a01ec6d-d090-40da-bdbf-5bb60b90157e. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.network.neutron [req-9773a435-e2bf-4a7b-9d1a-e3ed3745b844 req-f3c27831-7263-4c48-b045-ce5f737f2984 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Updating instance_info_cache with network_info: [{"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9773a435-e2bf-4a7b-9d1a-e3ed3745b844 req-f3c27831-7263-4c48-b045-ce5f737f2984 service nova] Releasing lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a01ec6d-d0, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a01ec6d-d0, col_values=(('qos', UUID('22a3d415-347b-426e-b6c3-58e6bf7d1e0d')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a01ec6d-d0, col_values=(('external_ids', {'iface-id': '9a01ec6d-d090-40da-bdbf-5bb60b90157e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:4b:33', 'vm-uuid': '16f56b6b-f08d-4650-b0eb-a202662b0eb6'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: INFO os_vif [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=9a01ec6d-d090-40da-bdbf-5bb60b90157e,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a01ec6d-d0')
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86d6abc5-af, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86d6abc5-af, col_values=(('qos', UUID('1d4d2504-295b-467f-8544-3ca1a5b719cf')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86d6abc5-af, col_values=(('external_ids', {'iface-id': '86d6abc5-af6c-4a7a-be0c-81dc149b5df7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:59:09', 'vm-uuid': '02b4446d-1538-4e80-b93d-5cb904b7b98f'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: INFO os_vif [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:59:09,bridge_name='br-int',has_traffic_filtering=True,id=86d6abc5-af6c-4a7a-be0c-81dc149b5df7,network=Network(bb78092d-2ba8-42bd-862e-b697ef77a6ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d6abc5-af')
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87b7f663-49, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87b7f663-49, col_values=(('qos', UUID('93f9a315-44b1-474b-a79a-b2b36bba0381')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87b7f663-49, col_values=(('external_ids', {'iface-id': '87b7f663-4936-4a68-b667-7097b5b46783', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:86:43', 'vm-uuid': '62e8cc12-802e-415c-a166-4590715372c5'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:48 user nova-compute[75285]: INFO os_vif [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:86:43,bridge_name='br-int',has_traffic_filtering=True,id=87b7f663-4936-4a68-b667-7097b5b46783,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b7f663-49')
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No VIF found with MAC fa:16:3e:e9:4b:33, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] No VIF found with MAC fa:16:3e:d6:59:09, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No VIF found with MAC fa:16:3e:32:86:43, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:02:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:49 user nova-compute[75285]: DEBUG nova.network.neutron [req-d2ac17e9-b5f9-4520-a6bb-9d815ca30577 req-4d217069-c805-4292-87bd-a01da1517149 service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Updated VIF entry in instance network info cache for port 86d6abc5-af6c-4a7a-be0c-81dc149b5df7. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:02:49 user nova-compute[75285]: DEBUG nova.network.neutron [req-d2ac17e9-b5f9-4520-a6bb-9d815ca30577 req-4d217069-c805-4292-87bd-a01da1517149 service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Updating instance_info_cache with network_info: [{"id": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "address": "fa:16:3e:d6:59:09", "network": {"id": "bb78092d-2ba8-42bd-862e-b697ef77a6ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958013330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d223d68b26463c93d4c8f203d5d597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d6abc5-af", "ovs_interfaceid": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:02:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d2ac17e9-b5f9-4520-a6bb-9d815ca30577 req-4d217069-c805-4292-87bd-a01da1517149 service nova] Releasing lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:02:50 user nova-compute[75285]: DEBUG nova.network.neutron [req-9d99f661-3dba-4089-81cf-42c61defe5c2 req-d171c503-a7a7-4e5e-a337-6c250a96e659 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Updated VIF entry in instance network info cache for port 87b7f663-4936-4a68-b667-7097b5b46783. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:02:50 user nova-compute[75285]: DEBUG nova.network.neutron [req-9d99f661-3dba-4089-81cf-42c61defe5c2 req-d171c503-a7a7-4e5e-a337-6c250a96e659 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Updating instance_info_cache with network_info: [{"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:02:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9d99f661-3dba-4089-81cf-42c61defe5c2 req-d171c503-a7a7-4e5e-a337-6c250a96e659 service nova] Releasing lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:02:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:02:55 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Instance spawned successfully.
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: INFO nova.compute.manager [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Took 16.11 seconds to spawn the instance on the hypervisor.
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:02:55 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Instance spawned successfully.
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:02:55 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Instance spawned successfully.
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:02:56 user nova-compute[75285]: INFO nova.compute.manager [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Took 17.49 seconds to build instance.
Nov 10 21:02:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8c78bdb2-c117-4777-9c39-5a766ed40f73 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.806s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:56 user nova-compute[75285]: INFO nova.compute.manager [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Took 14.95 seconds to spawn the instance on the hypervisor.
Nov 10 21:02:56 user nova-compute[75285]: DEBUG nova.compute.manager [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:02:56 user nova-compute[75285]: INFO nova.compute.manager [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Took 14.57 seconds to spawn the instance on the hypervisor.
Nov 10 21:02:56 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:02:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-64a04524-0ae6-4534-b19a-c080818ac90d req-1418e8b7-437e-404c-9cd9-b17bd4637f8e service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:02:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-64a04524-0ae6-4534-b19a-c080818ac90d req-1418e8b7-437e-404c-9cd9-b17bd4637f8e service nova] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-64a04524-0ae6-4534-b19a-c080818ac90d req-1418e8b7-437e-404c-9cd9-b17bd4637f8e service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-64a04524-0ae6-4534-b19a-c080818ac90d req-1418e8b7-437e-404c-9cd9-b17bd4637f8e service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-64a04524-0ae6-4534-b19a-c080818ac90d req-1418e8b7-437e-404c-9cd9-b17bd4637f8e service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] No waiting events found dispatching network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:02:56 user nova-compute[75285]: WARNING nova.compute.manager [req-64a04524-0ae6-4534-b19a-c080818ac90d req-1418e8b7-437e-404c-9cd9-b17bd4637f8e service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received unexpected event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e for instance with vm_state active and task_state None.
Nov 10 21:02:56 user nova-compute[75285]: INFO nova.compute.manager [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Took 16.48 seconds to build instance.
Nov 10 21:02:56 user nova-compute[75285]: INFO nova.compute.manager [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Took 16.68 seconds to build instance.
Nov 10 21:02:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8feb815d-3a8d-41f6-987f-2b8bf2088186 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "62e8cc12-802e-415c-a166-4590715372c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.707s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-847d70b9-b98b-45c1-9100-6f18c8c47a1d tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.917s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:02:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:02:57 user nova-compute[75285]: INFO nova.compute.claims [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Claim successful on node user
Nov 10 21:02:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] No waiting events found dispatching network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:02:58 user nova-compute[75285]: WARNING nova.compute.manager [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received unexpected event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e for instance with vm_state active and task_state None.
Nov 10 21:02:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Received event network-vif-plugged-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] Acquiring lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] No waiting events found dispatching network-vif-plugged-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:02:58 user nova-compute[75285]: WARNING nova.compute.manager [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Received unexpected event network-vif-plugged-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 for instance with vm_state active and task_state None.
Nov 10 21:02:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Received event network-vif-plugged-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] Acquiring lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] No waiting events found dispatching network-vif-plugged-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:02:58 user nova-compute[75285]: WARNING nova.compute.manager [req-b9c71527-39a5-4f7f-ab46-b95f276a0fab req-3e50c0f9-8fa1-467c-930a-09ad9e77488c service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Received unexpected event network-vif-plugged-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 for instance with vm_state active and task_state None.
Nov 10 21:02:58 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.733s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG nova.network.neutron [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:02:58 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:02:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:02:58 user nova-compute[75285]: DEBUG nova.policy [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92fecbd1e3364a73a2b02edfba7e894e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa427a4529a400b9f1067e756f7c681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:02:59 user nova-compute[75285]: DEBUG nova.compute.manager [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:02:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:02:59 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Creating image(s)
Nov 10 21:02:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "/opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "/opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "/opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.293s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:02:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:02:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.262s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:02:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk 1073741824" returned: 0 in 0.084s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:02:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:02:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG nova.network.neutron [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Successfully created port: 6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.334s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Cannot resize image /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Ensure instance console log exists: /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:01 user nova-compute[75285]: DEBUG nova.network.neutron [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Successfully updated port: 6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:03:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "refresh_cache-6db680e7-3e21-4451-a0b1-29f9eca59b2f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:03:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquired lock "refresh_cache-6db680e7-3e21-4451-a0b1-29f9eca59b2f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:03:01 user nova-compute[75285]: DEBUG nova.network.neutron [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:03:01 user nova-compute[75285]: DEBUG nova.compute.manager [req-daf64227-47ea-47bb-9ee3-2e55e994d67d req-4160bd87-5129-4bc1-ade5-9bd1df5e06cb service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Received event network-changed-6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:01 user nova-compute[75285]: DEBUG nova.compute.manager [req-daf64227-47ea-47bb-9ee3-2e55e994d67d req-4160bd87-5129-4bc1-ade5-9bd1df5e06cb service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Refreshing instance network info cache due to event network-changed-6335c90a-8b5b-4619-af6f-e420972d35d0. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:03:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-daf64227-47ea-47bb-9ee3-2e55e994d67d req-4160bd87-5129-4bc1-ade5-9bd1df5e06cb service nova] Acquiring lock "refresh_cache-6db680e7-3e21-4451-a0b1-29f9eca59b2f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:03:01 user nova-compute[75285]: DEBUG nova.network.neutron [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:03:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.network.neutron [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Updating instance_info_cache with network_info: [{"id": "6335c90a-8b5b-4619-af6f-e420972d35d0", "address": "fa:16:3e:9b:b6:31", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6335c90a-8b", "ovs_interfaceid": "6335c90a-8b5b-4619-af6f-e420972d35d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Releasing lock "refresh_cache-6db680e7-3e21-4451-a0b1-29f9eca59b2f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Instance network_info: |[{"id": "6335c90a-8b5b-4619-af6f-e420972d35d0", "address": "fa:16:3e:9b:b6:31", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6335c90a-8b", "ovs_interfaceid": "6335c90a-8b5b-4619-af6f-e420972d35d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-daf64227-47ea-47bb-9ee3-2e55e994d67d req-4160bd87-5129-4bc1-ade5-9bd1df5e06cb service nova] Acquired lock "refresh_cache-6db680e7-3e21-4451-a0b1-29f9eca59b2f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.network.neutron [req-daf64227-47ea-47bb-9ee3-2e55e994d67d req-4160bd87-5129-4bc1-ade5-9bd1df5e06cb service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Refreshing network info cache for port 6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Start _get_guest_xml network_info=[{"id": "6335c90a-8b5b-4619-af6f-e420972d35d0", "address": "fa:16:3e:9b:b6:31", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6335c90a-8b", "ovs_interfaceid": "6335c90a-8b5b-4619-af6f-e420972d35d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:03:02 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:03:02 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1603427953',display_name='tempest-VolumesAdminNegativeTest-server-1603427953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1603427953',id=4,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2O0huQTMv99HqkArDFlcTekmlYzR2YBg6tqwxXvXzeV+RBNnDTNpLhWJjvihsANa4hhE10kYsYg6080lB8Yryk0UyKVx0o83JoIfw73pKtuArg3+eR8hCu7nYcbvzoJg==',key_name='tempest-keypair-932573605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfa427a4529a400b9f1067e756f7c681',ramdisk_id='',reservation_id='r-0v0l3g5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-554707513',owner_user_name='tempest-VolumesAdminNegativeTest-554707513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92fecbd1e3364a73a2b02edfba7e894e',uuid=6db680e7-3e21-4451-a0b1-29f9eca59b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6335c90a-8b5b-4619-af6f-e420972d35d0", "address": "fa:16:3e:9b:b6:31", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6335c90a-8b", "ovs_interfaceid": "6335c90a-8b5b-4619-af6f-e420972d35d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Converting VIF {"id": "6335c90a-8b5b-4619-af6f-e420972d35d0", "address": "fa:16:3e:9b:b6:31", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6335c90a-8b", "ovs_interfaceid": "6335c90a-8b5b-4619-af6f-e420972d35d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b6:31,bridge_name='br-int',has_traffic_filtering=True,id=6335c90a-8b5b-4619-af6f-e420972d35d0,network=Network(ed40fbcd-a68a-4582-805a-09cdd3206893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6335c90a-8b') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.objects.instance [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lazy-loading 'pci_devices' on Instance uuid 6db680e7-3e21-4451-a0b1-29f9eca59b2f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:03:02 user nova-compute[75285]:   <uuid>6db680e7-3e21-4451-a0b1-29f9eca59b2f</uuid>
Nov 10 21:03:02 user nova-compute[75285]:   <name>instance-00000004</name>
Nov 10 21:03:02 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:03:02 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:03:02 user nova-compute[75285]:   <metadata>
Nov 10 21:03:02 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:03:02 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:03:02 user nova-compute[75285]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1603427953</nova:name>
Nov 10 21:03:02 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:03:02</nova:creationTime>
Nov 10 21:03:02 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:03:02 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:03:02 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:03:02 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:03:02 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:03:02 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:03:02 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:03:02 user nova-compute[75285]:       <nova:owner>
Nov 10 21:03:02 user nova-compute[75285]:         <nova:user uuid="92fecbd1e3364a73a2b02edfba7e894e">tempest-VolumesAdminNegativeTest-554707513-project-member</nova:user>
Nov 10 21:03:02 user nova-compute[75285]:         <nova:project uuid="dfa427a4529a400b9f1067e756f7c681">tempest-VolumesAdminNegativeTest-554707513</nova:project>
Nov 10 21:03:02 user nova-compute[75285]:       </nova:owner>
Nov 10 21:03:02 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:03:02 user nova-compute[75285]:       <nova:ports>
Nov 10 21:03:02 user nova-compute[75285]:         <nova:port uuid="6335c90a-8b5b-4619-af6f-e420972d35d0">
Nov 10 21:03:02 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 21:03:02 user nova-compute[75285]:         </nova:port>
Nov 10 21:03:02 user nova-compute[75285]:       </nova:ports>
Nov 10 21:03:02 user nova-compute[75285]:     </nova:instance>
Nov 10 21:03:02 user nova-compute[75285]:   </metadata>
Nov 10 21:03:02 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:03:02 user nova-compute[75285]:     <system>
Nov 10 21:03:02 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:03:02 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:03:02 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:03:02 user nova-compute[75285]:       <entry name="serial">6db680e7-3e21-4451-a0b1-29f9eca59b2f</entry>
Nov 10 21:03:02 user nova-compute[75285]:       <entry name="uuid">6db680e7-3e21-4451-a0b1-29f9eca59b2f</entry>
Nov 10 21:03:02 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:03:02 user nova-compute[75285]:     </system>
Nov 10 21:03:02 user nova-compute[75285]:   </sysinfo>
Nov 10 21:03:02 user nova-compute[75285]:   <os>
Nov 10 21:03:02 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:03:02 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:03:02 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:03:02 user nova-compute[75285]:   </os>
Nov 10 21:03:02 user nova-compute[75285]:   <features>
Nov 10 21:03:02 user nova-compute[75285]:     <acpi/>
Nov 10 21:03:02 user nova-compute[75285]:     <apic/>
Nov 10 21:03:02 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:03:02 user nova-compute[75285]:   </features>
Nov 10 21:03:02 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:03:02 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:03:02 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:03:02 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:03:02 user nova-compute[75285]:   </clock>
Nov 10 21:03:02 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:03:02 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:03:02 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:03:02 user nova-compute[75285]:   </cpu>
Nov 10 21:03:02 user nova-compute[75285]:   <devices>
Nov 10 21:03:02 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:03:02 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:03:02 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk"/>
Nov 10 21:03:02 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:03:02 user nova-compute[75285]:     </disk>
Nov 10 21:03:02 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:03:02 user nova-compute[75285]:       <mac address="fa:16:3e:9b:b6:31"/>
Nov 10 21:03:02 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:03:02 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:03:02 user nova-compute[75285]:       <target dev="tap6335c90a-8b"/>
Nov 10 21:03:02 user nova-compute[75285]:     </interface>
Nov 10 21:03:02 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:03:02 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/console.log" append="off"/>
Nov 10 21:03:02 user nova-compute[75285]:     </serial>
Nov 10 21:03:02 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:03:02 user nova-compute[75285]:     <video>
Nov 10 21:03:02 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:03:02 user nova-compute[75285]:     </video>
Nov 10 21:03:02 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:03:02 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:03:02 user nova-compute[75285]:     </rng>
Nov 10 21:03:02 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:03:02 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:03:02 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:03:02 user nova-compute[75285]:     </memballoon>
Nov 10 21:03:02 user nova-compute[75285]:   </devices>
Nov 10 21:03:02 user nova-compute[75285]: </domain>
Nov 10 21:03:02 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1603427953',display_name='tempest-VolumesAdminNegativeTest-server-1603427953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1603427953',id=4,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2O0huQTMv99HqkArDFlcTekmlYzR2YBg6tqwxXvXzeV+RBNnDTNpLhWJjvihsANa4hhE10kYsYg6080lB8Yryk0UyKVx0o83JoIfw73pKtuArg3+eR8hCu7nYcbvzoJg==',key_name='tempest-keypair-932573605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfa427a4529a400b9f1067e756f7c681',ramdisk_id='',reservation_id='r-0v0l3g5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-554707513',owner_user_name='tempest-VolumesAdminNegativeTest-554707513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92fecbd1e3364a73a2b02edfba7e894e',uuid=6db680e7-3e21-4451-a0b1-29f9eca59b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6335c90a-8b5b-4619-af6f-e420972d35d0", "address": "fa:16:3e:9b:b6:31", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6335c90a-8b", "ovs_interfaceid": "6335c90a-8b5b-4619-af6f-e420972d35d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Converting VIF {"id": "6335c90a-8b5b-4619-af6f-e420972d35d0", "address": "fa:16:3e:9b:b6:31", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6335c90a-8b", "ovs_interfaceid": "6335c90a-8b5b-4619-af6f-e420972d35d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b6:31,bridge_name='br-int',has_traffic_filtering=True,id=6335c90a-8b5b-4619-af6f-e420972d35d0,network=Network(ed40fbcd-a68a-4582-805a-09cdd3206893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6335c90a-8b') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG os_vif [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b6:31,bridge_name='br-int',has_traffic_filtering=True,id=6335c90a-8b5b-4619-af6f-e420972d35d0,network=Network(ed40fbcd-a68a-4582-805a-09cdd3206893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6335c90a-8b') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '182c8419-b4fc-5db2-bebc-db2ecef0673e', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6335c90a-8b, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6335c90a-8b, col_values=(('qos', UUID('79ef1f79-c81a-4e0b-86b5-71591435b1af')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6335c90a-8b, col_values=(('external_ids', {'iface-id': '6335c90a-8b5b-4619-af6f-e420972d35d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:b6:31', 'vm-uuid': '6db680e7-3e21-4451-a0b1-29f9eca59b2f'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:02 user nova-compute[75285]: INFO os_vif [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b6:31,bridge_name='br-int',has_traffic_filtering=True,id=6335c90a-8b5b-4619-af6f-e420972d35d0,network=Network(ed40fbcd-a68a-4582-805a-09cdd3206893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6335c90a-8b')
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] No VIF found with MAC fa:16:3e:9b:b6:31, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:03 user nova-compute[75285]: DEBUG nova.network.neutron [req-daf64227-47ea-47bb-9ee3-2e55e994d67d req-4160bd87-5129-4bc1-ade5-9bd1df5e06cb service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Updated VIF entry in instance network info cache for port 6335c90a-8b5b-4619-af6f-e420972d35d0. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:03:03 user nova-compute[75285]: DEBUG nova.network.neutron [req-daf64227-47ea-47bb-9ee3-2e55e994d67d req-4160bd87-5129-4bc1-ade5-9bd1df5e06cb service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Updating instance_info_cache with network_info: [{"id": "6335c90a-8b5b-4619-af6f-e420972d35d0", "address": "fa:16:3e:9b:b6:31", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6335c90a-8b", "ovs_interfaceid": "6335c90a-8b5b-4619-af6f-e420972d35d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:03:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-daf64227-47ea-47bb-9ee3-2e55e994d67d req-4160bd87-5129-4bc1-ade5-9bd1df5e06cb service nova] Releasing lock "refresh_cache-6db680e7-3e21-4451-a0b1-29f9eca59b2f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:03:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-cb4df575-8ff1-422d-bf56-ecc25e8fecdb req-b1f09071-9abb-4266-9b85-cf14db3759c8 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received event network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cb4df575-8ff1-422d-bf56-ecc25e8fecdb req-b1f09071-9abb-4266-9b85-cf14db3759c8 service nova] Acquiring lock "62e8cc12-802e-415c-a166-4590715372c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cb4df575-8ff1-422d-bf56-ecc25e8fecdb req-b1f09071-9abb-4266-9b85-cf14db3759c8 service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cb4df575-8ff1-422d-bf56-ecc25e8fecdb req-b1f09071-9abb-4266-9b85-cf14db3759c8 service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-cb4df575-8ff1-422d-bf56-ecc25e8fecdb req-b1f09071-9abb-4266-9b85-cf14db3759c8 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] No waiting events found dispatching network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:03:03 user nova-compute[75285]: WARNING nova.compute.manager [req-cb4df575-8ff1-422d-bf56-ecc25e8fecdb req-b1f09071-9abb-4266-9b85-cf14db3759c8 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received unexpected event network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 for instance with vm_state active and task_state None.
Nov 10 21:03:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "ec5dca1b-b623-4a12-af56-aa2bce208869" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:03:05 user nova-compute[75285]: DEBUG nova.compute.manager [req-e41e1498-d5f4-4a33-b83a-21924856fc4b req-9d2e7c5c-9a8a-4b8d-8018-f47100aafc01 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received event network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e41e1498-d5f4-4a33-b83a-21924856fc4b req-9d2e7c5c-9a8a-4b8d-8018-f47100aafc01 service nova] Acquiring lock "62e8cc12-802e-415c-a166-4590715372c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e41e1498-d5f4-4a33-b83a-21924856fc4b req-9d2e7c5c-9a8a-4b8d-8018-f47100aafc01 service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e41e1498-d5f4-4a33-b83a-21924856fc4b req-9d2e7c5c-9a8a-4b8d-8018-f47100aafc01 service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:05 user nova-compute[75285]: DEBUG nova.compute.manager [req-e41e1498-d5f4-4a33-b83a-21924856fc4b req-9d2e7c5c-9a8a-4b8d-8018-f47100aafc01 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] No waiting events found dispatching network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:03:05 user nova-compute[75285]: WARNING nova.compute.manager [req-e41e1498-d5f4-4a33-b83a-21924856fc4b req-9d2e7c5c-9a8a-4b8d-8018-f47100aafc01 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received unexpected event network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 for instance with vm_state active and task_state None.
Nov 10 21:03:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:06 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:03:06 user nova-compute[75285]: INFO nova.compute.claims [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Claim successful on node user
Nov 10 21:03:06 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:03:06 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:03:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.741s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:06 user nova-compute[75285]: DEBUG nova.compute.manager [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:03:07 user nova-compute[75285]: DEBUG nova.compute.manager [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:03:07 user nova-compute[75285]: DEBUG nova.network.neutron [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:03:07 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 10 21:03:07 user nova-compute[75285]: DEBUG nova.compute.manager [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:03:07 user nova-compute[75285]: DEBUG nova.policy [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc503491280b4db7a8dc3b1cd866dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ceffccaaef04b4ebb2fc39daf3a66ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:03:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:07 user nova-compute[75285]: DEBUG nova.compute.manager [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:03:07 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:03:07 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Creating image(s)
Nov 10 21:03:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "/opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "/opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2.part --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:03:08 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Instance spawned successfully.
Nov 10 21:03:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2.part --force-share --output=json" returned: 0 in 0.340s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG nova.virt.images [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] 5d30289a-3cd5-4718-9ea9-b7c22634f03a was qcow2, converting to raw {{(pid=75285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2.part /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2.converted {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:08 user nova-compute[75285]: INFO nova.compute.manager [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Took 9.57 seconds to spawn the instance on the hypervisor.
Nov 10 21:03:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG nova.network.neutron [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Successfully created port: 9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2.part /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2.converted" returned: 0 in 0.277s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2.converted --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:08 user nova-compute[75285]: INFO nova.compute.manager [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Took 10.99 seconds to build instance.
Nov 10 21:03:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17dae554-7f19-4198-b7f1-0fb6774a8c92 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.156s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2.converted --force-share --output=json" returned: 0 in 0.278s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.621s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2 --force-share --output=json" returned: 0 in 0.274s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2 --force-share --output=json" returned: 0 in 0.327s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2,backing_fmt=raw /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2,backing_fmt=raw /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk 1073741824" returned: 0 in 0.069s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.409s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG nova.network.neutron [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Successfully updated port: 9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "refresh_cache-ec5dca1b-b623-4a12-af56-aa2bce208869" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquired lock "refresh_cache-ec5dca1b-b623-4a12-af56-aa2bce208869" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:03:09 user nova-compute[75285]: DEBUG nova.network.neutron [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-dad04c1b-ed41-4149-8524-e6ec3dca92f8 req-3dd8760c-dafc-4e15-a784-d768f12942c8 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Received event network-changed-9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-dad04c1b-ed41-4149-8524-e6ec3dca92f8 req-3dd8760c-dafc-4e15-a784-d768f12942c8 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Refreshing instance network info cache due to event network-changed-9179b028-23d4-4b6e-bac0-9df516cc9dfe. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-dad04c1b-ed41-4149-8524-e6ec3dca92f8 req-3dd8760c-dafc-4e15-a784-d768f12942c8 service nova] Acquiring lock "refresh_cache-ec5dca1b-b623-4a12-af56-aa2bce208869" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2 --force-share --output=json" returned: 0 in 0.309s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.network.neutron [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Cannot resize image /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Ensure instance console log exists: /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.network.neutron [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Updating instance_info_cache with network_info: [{"id": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "address": "fa:16:3e:79:58:f8", "network": {"id": "35b31ce0-80bb-48f2-a9dd-1c30acbca7e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1234893326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ceffccaaef04b4ebb2fc39daf3a66ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9179b028-23", "ovs_interfaceid": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Releasing lock "refresh_cache-ec5dca1b-b623-4a12-af56-aa2bce208869" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Instance network_info: |[{"id": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "address": "fa:16:3e:79:58:f8", "network": {"id": "35b31ce0-80bb-48f2-a9dd-1c30acbca7e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1234893326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ceffccaaef04b4ebb2fc39daf3a66ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9179b028-23", "ovs_interfaceid": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-dad04c1b-ed41-4149-8524-e6ec3dca92f8 req-3dd8760c-dafc-4e15-a784-d768f12942c8 service nova] Acquired lock "refresh_cache-ec5dca1b-b623-4a12-af56-aa2bce208869" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.network.neutron [req-dad04c1b-ed41-4149-8524-e6ec3dca92f8 req-3dd8760c-dafc-4e15-a784-d768f12942c8 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Refreshing network info cache for port 9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Start _get_guest_xml network_info=[{"id": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "address": "fa:16:3e:79:58:f8", "network": {"id": "35b31ce0-80bb-48f2-a9dd-1c30acbca7e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1234893326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ceffccaaef04b4ebb2fc39daf3a66ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9179b028-23", "ovs_interfaceid": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T21:02:56Z,direct_url=<?>,disk_format='qcow2',id=5d30289a-3cd5-4718-9ea9-b7c22634f03a,min_disk=0,min_ram=0,name='',owner='863b17c2448f41ff9e216bbc30098a1c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T21:02:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'scsi', 'image_id': '5d30289a-3cd5-4718-9ea9-b7c22634f03a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:03:10 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:03:10 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T21:02:56Z,direct_url=<?>,disk_format='qcow2',id=5d30289a-3cd5-4718-9ea9-b7c22634f03a,min_disk=0,min_ram=0,name='',owner='863b17c2448f41ff9e216bbc30098a1c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T21:02:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1494260737',display_name='tempest-AttachSCSIVolumeTestJSON-server-1494260737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1494260737',id=5,image_ref='5d30289a-3cd5-4718-9ea9-b7c22634f03a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQXbzJQJ9OTkEJhGd9LF6nEvURELc2jbg5QFrJPwkL7j7Zu84R7K8F14+/zWXNYdfK6kdK0F687pvjtZgtL1FNETSXMDHWeldRMR0FJN8goWiPI21YE4dOcR4E++TlGzw==',key_name='tempest-keypair-109077833',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ceffccaaef04b4ebb2fc39daf3a66ae',ramdisk_id='',reservation_id='r-xokoq71b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d30289a-3cd5-4718-9ea9-b7c22634f03a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1853623146',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1853623146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc503491280b4db7a8dc3b1cd866dedb',uuid=ec5dca1b-b623-4a12-af56-aa2bce208869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "address": "fa:16:3e:79:58:f8", "network": {"id": "35b31ce0-80bb-48f2-a9dd-1c30acbca7e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1234893326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ceffccaaef04b4ebb2fc39daf3a66ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9179b028-23", "ovs_interfaceid": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Converting VIF {"id": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "address": "fa:16:3e:79:58:f8", "network": {"id": "35b31ce0-80bb-48f2-a9dd-1c30acbca7e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1234893326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ceffccaaef04b4ebb2fc39daf3a66ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9179b028-23", "ovs_interfaceid": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:58:f8,bridge_name='br-int',has_traffic_filtering=True,id=9179b028-23d4-4b6e-bac0-9df516cc9dfe,network=Network(35b31ce0-80bb-48f2-a9dd-1c30acbca7e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9179b028-23') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.objects.instance [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lazy-loading 'pci_devices' on Instance uuid ec5dca1b-b623-4a12-af56-aa2bce208869 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:03:10 user nova-compute[75285]:   <uuid>ec5dca1b-b623-4a12-af56-aa2bce208869</uuid>
Nov 10 21:03:10 user nova-compute[75285]:   <name>instance-00000005</name>
Nov 10 21:03:10 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:03:10 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:03:10 user nova-compute[75285]:   <metadata>
Nov 10 21:03:10 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:03:10 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:03:10 user nova-compute[75285]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1494260737</nova:name>
Nov 10 21:03:10 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:03:10</nova:creationTime>
Nov 10 21:03:10 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:03:10 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:03:10 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:03:10 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:03:10 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:03:10 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:03:10 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:03:10 user nova-compute[75285]:       <nova:owner>
Nov 10 21:03:10 user nova-compute[75285]:         <nova:user uuid="dc503491280b4db7a8dc3b1cd866dedb">tempest-AttachSCSIVolumeTestJSON-1853623146-project-member</nova:user>
Nov 10 21:03:10 user nova-compute[75285]:         <nova:project uuid="5ceffccaaef04b4ebb2fc39daf3a66ae">tempest-AttachSCSIVolumeTestJSON-1853623146</nova:project>
Nov 10 21:03:10 user nova-compute[75285]:       </nova:owner>
Nov 10 21:03:10 user nova-compute[75285]:       <nova:root type="image" uuid="5d30289a-3cd5-4718-9ea9-b7c22634f03a"/>
Nov 10 21:03:10 user nova-compute[75285]:       <nova:ports>
Nov 10 21:03:10 user nova-compute[75285]:         <nova:port uuid="9179b028-23d4-4b6e-bac0-9df516cc9dfe">
Nov 10 21:03:10 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 21:03:10 user nova-compute[75285]:         </nova:port>
Nov 10 21:03:10 user nova-compute[75285]:       </nova:ports>
Nov 10 21:03:10 user nova-compute[75285]:     </nova:instance>
Nov 10 21:03:10 user nova-compute[75285]:   </metadata>
Nov 10 21:03:10 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:03:10 user nova-compute[75285]:     <system>
Nov 10 21:03:10 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:03:10 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:03:10 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:03:10 user nova-compute[75285]:       <entry name="serial">ec5dca1b-b623-4a12-af56-aa2bce208869</entry>
Nov 10 21:03:10 user nova-compute[75285]:       <entry name="uuid">ec5dca1b-b623-4a12-af56-aa2bce208869</entry>
Nov 10 21:03:10 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:03:10 user nova-compute[75285]:     </system>
Nov 10 21:03:10 user nova-compute[75285]:   </sysinfo>
Nov 10 21:03:10 user nova-compute[75285]:   <os>
Nov 10 21:03:10 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:03:10 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:03:10 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:03:10 user nova-compute[75285]:   </os>
Nov 10 21:03:10 user nova-compute[75285]:   <features>
Nov 10 21:03:10 user nova-compute[75285]:     <acpi/>
Nov 10 21:03:10 user nova-compute[75285]:     <apic/>
Nov 10 21:03:10 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:03:10 user nova-compute[75285]:   </features>
Nov 10 21:03:10 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:03:10 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:03:10 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:03:10 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:03:10 user nova-compute[75285]:   </clock>
Nov 10 21:03:10 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:03:10 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:03:10 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:03:10 user nova-compute[75285]:   </cpu>
Nov 10 21:03:10 user nova-compute[75285]:   <devices>
Nov 10 21:03:10 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:03:10 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:03:10 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk"/>
Nov 10 21:03:10 user nova-compute[75285]:       <target dev="sda" bus="scsi"/>
Nov 10 21:03:10 user nova-compute[75285]:       <address type="drive" controller="0" unit="0"/>
Nov 10 21:03:10 user nova-compute[75285]:     </disk>
Nov 10 21:03:10 user nova-compute[75285]:     <disk type="file" device="cdrom">
Nov 10 21:03:10 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 21:03:10 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk.config"/>
Nov 10 21:03:10 user nova-compute[75285]:       <target dev="sdb" bus="scsi"/>
Nov 10 21:03:10 user nova-compute[75285]:       <address type="drive" controller="0" unit="1"/>
Nov 10 21:03:10 user nova-compute[75285]:     </disk>
Nov 10 21:03:10 user nova-compute[75285]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 10 21:03:10 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:03:10 user nova-compute[75285]:       <mac address="fa:16:3e:79:58:f8"/>
Nov 10 21:03:10 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:03:10 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:03:10 user nova-compute[75285]:       <target dev="tap9179b028-23"/>
Nov 10 21:03:10 user nova-compute[75285]:     </interface>
Nov 10 21:03:10 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:03:10 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/console.log" append="off"/>
Nov 10 21:03:10 user nova-compute[75285]:     </serial>
Nov 10 21:03:10 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:03:10 user nova-compute[75285]:     <video>
Nov 10 21:03:10 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:03:10 user nova-compute[75285]:     </video>
Nov 10 21:03:10 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:03:10 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:03:10 user nova-compute[75285]:     </rng>
Nov 10 21:03:10 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:03:10 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:03:10 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:03:10 user nova-compute[75285]:     </memballoon>
Nov 10 21:03:10 user nova-compute[75285]:   </devices>
Nov 10 21:03:10 user nova-compute[75285]: </domain>
Nov 10 21:03:10 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1494260737',display_name='tempest-AttachSCSIVolumeTestJSON-server-1494260737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1494260737',id=5,image_ref='5d30289a-3cd5-4718-9ea9-b7c22634f03a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQXbzJQJ9OTkEJhGd9LF6nEvURELc2jbg5QFrJPwkL7j7Zu84R7K8F14+/zWXNYdfK6kdK0F687pvjtZgtL1FNETSXMDHWeldRMR0FJN8goWiPI21YE4dOcR4E++TlGzw==',key_name='tempest-keypair-109077833',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ceffccaaef04b4ebb2fc39daf3a66ae',ramdisk_id='',reservation_id='r-xokoq71b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d30289a-3cd5-4718-9ea9-b7c22634f03a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1853623146',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1853623146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc503491280b4db7a8dc3b1cd866dedb',uuid=ec5dca1b-b623-4a12-af56-aa2bce208869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "address": "fa:16:3e:79:58:f8", "network": {"id": "35b31ce0-80bb-48f2-a9dd-1c30acbca7e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1234893326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ceffccaaef04b4ebb2fc39daf3a66ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9179b028-23", "ovs_interfaceid": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Converting VIF {"id": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "address": "fa:16:3e:79:58:f8", "network": {"id": "35b31ce0-80bb-48f2-a9dd-1c30acbca7e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1234893326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ceffccaaef04b4ebb2fc39daf3a66ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9179b028-23", "ovs_interfaceid": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:58:f8,bridge_name='br-int',has_traffic_filtering=True,id=9179b028-23d4-4b6e-bac0-9df516cc9dfe,network=Network(35b31ce0-80bb-48f2-a9dd-1c30acbca7e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9179b028-23') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG os_vif [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:58:f8,bridge_name='br-int',has_traffic_filtering=True,id=9179b028-23d4-4b6e-bac0-9df516cc9dfe,network=Network(35b31ce0-80bb-48f2-a9dd-1c30acbca7e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9179b028-23') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60a54b77-dfec-5878-844c-3e7e355e1fab', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9179b028-23, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9179b028-23, col_values=(('qos', UUID('b3d407e6-b89c-48e6-a1ae-deeda001ac2e')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9179b028-23, col_values=(('external_ids', {'iface-id': '9179b028-23d4-4b6e-bac0-9df516cc9dfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:58:f8', 'vm-uuid': 'ec5dca1b-b623-4a12-af56-aa2bce208869'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:10 user nova-compute[75285]: INFO os_vif [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:58:f8,bridge_name='br-int',has_traffic_filtering=True,id=9179b028-23d4-4b6e-bac0-9df516cc9dfe,network=Network(35b31ce0-80bb-48f2-a9dd-1c30acbca7e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9179b028-23')
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] No BDM found with device name sda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:03:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] No VIF found with MAC fa:16:3e:79:58:f8, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:03:10 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Using config drive
Nov 10 21:03:11 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Creating config drive at /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk.config
Nov 10 21:03:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpexbhj8ud {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:11 user nova-compute[75285]: DEBUG nova.network.neutron [req-dad04c1b-ed41-4149-8524-e6ec3dca92f8 req-3dd8760c-dafc-4e15-a784-d768f12942c8 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Updated VIF entry in instance network info cache for port 9179b028-23d4-4b6e-bac0-9df516cc9dfe. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:03:11 user nova-compute[75285]: DEBUG nova.network.neutron [req-dad04c1b-ed41-4149-8524-e6ec3dca92f8 req-3dd8760c-dafc-4e15-a784-d768f12942c8 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Updating instance_info_cache with network_info: [{"id": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "address": "fa:16:3e:79:58:f8", "network": {"id": "35b31ce0-80bb-48f2-a9dd-1c30acbca7e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1234893326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ceffccaaef04b4ebb2fc39daf3a66ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9179b028-23", "ovs_interfaceid": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:03:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpexbhj8ud" returned: 0 in 0.110s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-dad04c1b-ed41-4149-8524-e6ec3dca92f8 req-3dd8760c-dafc-4e15-a784-d768f12942c8 service nova] Releasing lock "refresh_cache-ec5dca1b-b623-4a12-af56-aa2bce208869" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:03:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "431a5e3b-068c-4da3-8198-85b4dcafd266" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:12 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:03:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:12 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:03:12 user nova-compute[75285]: INFO nova.compute.claims [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Claim successful on node user
Nov 10 21:03:13 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:03:13 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:03:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:03:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:03:13 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:03:13 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:03:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:03:13 user nova-compute[75285]: DEBUG nova.policy [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f018af822634a0b8b9902c811637795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc434b2e3e46c3998436f1c6ae971a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:03:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:03:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:03:13 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Creating image(s)
Nov 10 21:03:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.312s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.287s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk 1073741824" returned: 0 in 0.067s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.362s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.250s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Checking if we can resize image /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Successfully created port: 46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Cannot resize image /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Ensure instance console log exists: /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:15 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Successfully updated port: 46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:03:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:03:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquired lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:03:15 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-a68b21a6-25e1-4cdf-b91e-0c6ccb088abc req-6e1013d0-a609-4ca3-8a03-5d579fd83dd3 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received event network-changed-46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-a68b21a6-25e1-4cdf-b91e-0c6ccb088abc req-6e1013d0-a609-4ca3-8a03-5d579fd83dd3 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Refreshing instance network info cache due to event network-changed-46353ed3-1736-493a-99b8-580504a9abc9. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a68b21a6-25e1-4cdf-b91e-0c6ccb088abc req-6e1013d0-a609-4ca3-8a03-5d579fd83dd3 service nova] Acquiring lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Updating instance_info_cache with network_info: [{"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Releasing lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Instance network_info: |[{"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a68b21a6-25e1-4cdf-b91e-0c6ccb088abc req-6e1013d0-a609-4ca3-8a03-5d579fd83dd3 service nova] Acquired lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.network.neutron [req-a68b21a6-25e1-4cdf-b91e-0c6ccb088abc req-6e1013d0-a609-4ca3-8a03-5d579fd83dd3 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Refreshing network info cache for port 46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Start _get_guest_xml network_info=[{"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:03:16 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:03:16 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1188264763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1188264763',id=6,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJVDaV9K6SBR1XEp4BdAS6FdSHtLIn40w3r0dF5WwWJ6G68NbKximpSS6o3RxdgTS65FI2WOslaptWqshVaLeSVBsAD2z4r2afuysf1qmQl+94ffn2lCbbP+vU1cmDehA==',key_name='tempest-keypair-1028305531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96cc434b2e3e46c3998436f1c6ae971a',ramdisk_id='',reservation_id='r-dswcb0qh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-941419187',owner_user_name='tempest-TaggedAttachmentsTest-941419187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f018af822634a0b8b9902c811637795',uuid=431a5e3b-068c-4da3-8198-85b4dcafd266,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Converting VIF {"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:22:3a,bridge_name='br-int',has_traffic_filtering=True,id=46353ed3-1736-493a-99b8-580504a9abc9,network=Network(7b398720-77ce-449f-8413-d2f602a7ecd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46353ed3-17') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lazy-loading 'pci_devices' on Instance uuid 431a5e3b-068c-4da3-8198-85b4dcafd266 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:03:16 user nova-compute[75285]:   <uuid>431a5e3b-068c-4da3-8198-85b4dcafd266</uuid>
Nov 10 21:03:16 user nova-compute[75285]:   <name>instance-00000006</name>
Nov 10 21:03:16 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:03:16 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:03:16 user nova-compute[75285]:   <metadata>
Nov 10 21:03:16 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:03:16 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:03:16 user nova-compute[75285]:       <nova:name>tempest-device-tagging-server-1188264763</nova:name>
Nov 10 21:03:16 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:03:16</nova:creationTime>
Nov 10 21:03:16 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:03:16 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:03:16 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:03:16 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:03:16 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:03:16 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:03:16 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:03:16 user nova-compute[75285]:       <nova:owner>
Nov 10 21:03:16 user nova-compute[75285]:         <nova:user uuid="0f018af822634a0b8b9902c811637795">tempest-TaggedAttachmentsTest-941419187-project-member</nova:user>
Nov 10 21:03:16 user nova-compute[75285]:         <nova:project uuid="96cc434b2e3e46c3998436f1c6ae971a">tempest-TaggedAttachmentsTest-941419187</nova:project>
Nov 10 21:03:16 user nova-compute[75285]:       </nova:owner>
Nov 10 21:03:16 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:03:16 user nova-compute[75285]:       <nova:ports>
Nov 10 21:03:16 user nova-compute[75285]:         <nova:port uuid="46353ed3-1736-493a-99b8-580504a9abc9">
Nov 10 21:03:16 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 21:03:16 user nova-compute[75285]:         </nova:port>
Nov 10 21:03:16 user nova-compute[75285]:       </nova:ports>
Nov 10 21:03:16 user nova-compute[75285]:     </nova:instance>
Nov 10 21:03:16 user nova-compute[75285]:   </metadata>
Nov 10 21:03:16 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:03:16 user nova-compute[75285]:     <system>
Nov 10 21:03:16 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:03:16 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:03:16 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:03:16 user nova-compute[75285]:       <entry name="serial">431a5e3b-068c-4da3-8198-85b4dcafd266</entry>
Nov 10 21:03:16 user nova-compute[75285]:       <entry name="uuid">431a5e3b-068c-4da3-8198-85b4dcafd266</entry>
Nov 10 21:03:16 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:03:16 user nova-compute[75285]:     </system>
Nov 10 21:03:16 user nova-compute[75285]:   </sysinfo>
Nov 10 21:03:16 user nova-compute[75285]:   <os>
Nov 10 21:03:16 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:03:16 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:03:16 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:03:16 user nova-compute[75285]:   </os>
Nov 10 21:03:16 user nova-compute[75285]:   <features>
Nov 10 21:03:16 user nova-compute[75285]:     <acpi/>
Nov 10 21:03:16 user nova-compute[75285]:     <apic/>
Nov 10 21:03:16 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:03:16 user nova-compute[75285]:   </features>
Nov 10 21:03:16 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:03:16 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:03:16 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:03:16 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:03:16 user nova-compute[75285]:   </clock>
Nov 10 21:03:16 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:03:16 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:03:16 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:03:16 user nova-compute[75285]:   </cpu>
Nov 10 21:03:16 user nova-compute[75285]:   <devices>
Nov 10 21:03:16 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:03:16 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:03:16 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk"/>
Nov 10 21:03:16 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:03:16 user nova-compute[75285]:     </disk>
Nov 10 21:03:16 user nova-compute[75285]:     <disk type="file" device="cdrom">
Nov 10 21:03:16 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 21:03:16 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk.config"/>
Nov 10 21:03:16 user nova-compute[75285]:       <target dev="hda" bus="ide"/>
Nov 10 21:03:16 user nova-compute[75285]:     </disk>
Nov 10 21:03:16 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:03:16 user nova-compute[75285]:       <mac address="fa:16:3e:06:22:3a"/>
Nov 10 21:03:16 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:03:16 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:03:16 user nova-compute[75285]:       <target dev="tap46353ed3-17"/>
Nov 10 21:03:16 user nova-compute[75285]:     </interface>
Nov 10 21:03:16 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:03:16 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/console.log" append="off"/>
Nov 10 21:03:16 user nova-compute[75285]:     </serial>
Nov 10 21:03:16 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:03:16 user nova-compute[75285]:     <video>
Nov 10 21:03:16 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:03:16 user nova-compute[75285]:     </video>
Nov 10 21:03:16 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:03:16 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:03:16 user nova-compute[75285]:     </rng>
Nov 10 21:03:16 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:03:16 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:03:16 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:03:16 user nova-compute[75285]:     </memballoon>
Nov 10 21:03:16 user nova-compute[75285]:   </devices>
Nov 10 21:03:16 user nova-compute[75285]: </domain>
Nov 10 21:03:16 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1188264763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1188264763',id=6,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJVDaV9K6SBR1XEp4BdAS6FdSHtLIn40w3r0dF5WwWJ6G68NbKximpSS6o3RxdgTS65FI2WOslaptWqshVaLeSVBsAD2z4r2afuysf1qmQl+94ffn2lCbbP+vU1cmDehA==',key_name='tempest-keypair-1028305531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96cc434b2e3e46c3998436f1c6ae971a',ramdisk_id='',reservation_id='r-dswcb0qh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-941419187',owner_user_name='tempest-TaggedAttachmentsTest-941419187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f018af822634a0b8b9902c811637795',uuid=431a5e3b-068c-4da3-8198-85b4dcafd266,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Converting VIF {"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:22:3a,bridge_name='br-int',has_traffic_filtering=True,id=46353ed3-1736-493a-99b8-580504a9abc9,network=Network(7b398720-77ce-449f-8413-d2f602a7ecd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46353ed3-17') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG os_vif [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:22:3a,bridge_name='br-int',has_traffic_filtering=True,id=46353ed3-1736-493a-99b8-580504a9abc9,network=Network(7b398720-77ce-449f-8413-d2f602a7ecd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46353ed3-17') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '615bc808-afa6-54bc-bc48-501422d0d798', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46353ed3-17, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46353ed3-17, col_values=(('qos', UUID('0975bddf-095e-4856-89fa-0c97d1f81349')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46353ed3-17, col_values=(('external_ids', {'iface-id': '46353ed3-1736-493a-99b8-580504a9abc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:22:3a', 'vm-uuid': '431a5e3b-068c-4da3-8198-85b4dcafd266'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:16 user nova-compute[75285]: INFO os_vif [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:22:3a,bridge_name='br-int',has_traffic_filtering=True,id=46353ed3-1736-493a-99b8-580504a9abc9,network=Network(7b398720-77ce-449f-8413-d2f602a7ecd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46353ed3-17')
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] No BDM found with device name hda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] No VIF found with MAC fa:16:3e:06:22:3a, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:03:16 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Using config drive
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:03:16 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Instance spawned successfully.
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:16 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:03:16 user nova-compute[75285]: INFO nova.compute.claims [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Claim successful on node user
Nov 10 21:03:17 user nova-compute[75285]: INFO nova.compute.manager [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Took 9.62 seconds to spawn the instance on the hypervisor.
Nov 10 21:03:17 user nova-compute[75285]: DEBUG nova.compute.manager [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:03:17 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Creating config drive at /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk.config
Nov 10 21:03:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw99bxjp6 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw99bxjp6" returned: 0 in 0.080s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:17 user nova-compute[75285]: INFO nova.compute.manager [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Took 11.25 seconds to build instance.
Nov 10 21:03:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-42ac0e5e-72ca-4bf8-9efc-2eac9c3104d9 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.505s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG nova.network.neutron [req-a68b21a6-25e1-4cdf-b91e-0c6ccb088abc req-6e1013d0-a609-4ca3-8a03-5d579fd83dd3 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Updated VIF entry in instance network info cache for port 46353ed3-1736-493a-99b8-580504a9abc9. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG nova.network.neutron [req-a68b21a6-25e1-4cdf-b91e-0c6ccb088abc req-6e1013d0-a609-4ca3-8a03-5d579fd83dd3 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Updating instance_info_cache with network_info: [{"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a68b21a6-25e1-4cdf-b91e-0c6ccb088abc req-6e1013d0-a609-4ca3-8a03-5d579fd83dd3 service nova] Releasing lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.696s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:03:17 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:03:17 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG nova.policy [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '225156b687544aa98c6fd6d0e5ba7c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbb80a67cb94284b19514d996fd0bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:03:17 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Creating image(s)
Nov 10 21:03:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "/opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "/opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.270s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.277s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk 1073741824" returned: 0 in 0.066s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.287s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:18 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:03:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:19 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Successfully created port: 996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:03:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json" returned: 0 in 0.357s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:19 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Cannot resize image /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:03:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:03:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Ensure instance console log exists: /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:03:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:20 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Successfully updated port: 996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:03:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "refresh_cache-8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:03:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquired lock "refresh_cache-8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:03:20 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:03:20 user nova-compute[75285]: DEBUG nova.compute.manager [req-d53b681c-74ef-46c9-8a63-4a394561b338 req-158bf0e7-b0d6-4f22-9fcd-69e0c955bf03 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received event network-changed-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:20 user nova-compute[75285]: DEBUG nova.compute.manager [req-d53b681c-74ef-46c9-8a63-4a394561b338 req-158bf0e7-b0d6-4f22-9fcd-69e0c955bf03 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Refreshing instance network info cache due to event network-changed-996db12a-8c23-4a7e-91f4-e0f87358b2a6. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:03:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d53b681c-74ef-46c9-8a63-4a394561b338 req-158bf0e7-b0d6-4f22-9fcd-69e0c955bf03 service nova] Acquiring lock "refresh_cache-8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:03:20 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:03:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Acquiring lock "82a83f12-0822-4cd0-8d1b-3f939a601745" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.compute.manager [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Updating instance_info_cache with network_info: [{"id": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "address": "fa:16:3e:1f:23:b7", "network": {"id": "10f7fc99-7b04-4985-b19e-fb751f9b528c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1893985114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb80a67cb94284b19514d996fd0bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996db12a-8c", "ovs_interfaceid": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Releasing lock "refresh_cache-8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Instance network_info: |[{"id": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "address": "fa:16:3e:1f:23:b7", "network": {"id": "10f7fc99-7b04-4985-b19e-fb751f9b528c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1893985114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb80a67cb94284b19514d996fd0bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996db12a-8c", "ovs_interfaceid": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d53b681c-74ef-46c9-8a63-4a394561b338 req-158bf0e7-b0d6-4f22-9fcd-69e0c955bf03 service nova] Acquired lock "refresh_cache-8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.network.neutron [req-d53b681c-74ef-46c9-8a63-4a394561b338 req-158bf0e7-b0d6-4f22-9fcd-69e0c955bf03 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Refreshing network info cache for port 996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Start _get_guest_xml network_info=[{"id": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "address": "fa:16:3e:1f:23:b7", "network": {"id": "10f7fc99-7b04-4985-b19e-fb751f9b528c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1893985114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb80a67cb94284b19514d996fd0bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996db12a-8c", "ovs_interfaceid": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:03:21 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:03:21 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-989310564',display_name='tempest-TestVolumeSwap-server-989310564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-989310564',id=7,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFY5NNWOUGwA9ea1DnxPF3BGBncJ2wpHoqKPwpsPxQv8U3ZCURja7QkDTcPO5mzDJXaZBy6nyIwfISM/9koc1orS/qxoGk5nUBE70vuuXz+brj6jqF2nHLXDrslPOX2vQ==',key_name='tempest-keypair-691951150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbb80a67cb94284b19514d996fd0bb3',ramdisk_id='',reservation_id='r-o2ny1w52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-671625234',owner_user_name='tempest-TestVolumeSwap-671625234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:03:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='225156b687544aa98c6fd6d0e5ba7c38',uuid=8f6ad802-6f8f-42bc-95bd-934f4c9f55c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "address": "fa:16:3e:1f:23:b7", "network": {"id": "10f7fc99-7b04-4985-b19e-fb751f9b528c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1893985114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb80a67cb94284b19514d996fd0bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996db12a-8c", "ovs_interfaceid": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Converting VIF {"id": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "address": "fa:16:3e:1f:23:b7", "network": {"id": "10f7fc99-7b04-4985-b19e-fb751f9b528c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1893985114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb80a67cb94284b19514d996fd0bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996db12a-8c", "ovs_interfaceid": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:23:b7,bridge_name='br-int',has_traffic_filtering=True,id=996db12a-8c23-4a7e-91f4-e0f87358b2a6,network=Network(10f7fc99-7b04-4985-b19e-fb751f9b528c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996db12a-8c') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.objects.instance [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:03:21 user nova-compute[75285]: INFO nova.compute.claims [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Claim successful on node user
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:03:21 user nova-compute[75285]:   <uuid>8f6ad802-6f8f-42bc-95bd-934f4c9f55c3</uuid>
Nov 10 21:03:21 user nova-compute[75285]:   <name>instance-00000007</name>
Nov 10 21:03:21 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:03:21 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:03:21 user nova-compute[75285]:   <metadata>
Nov 10 21:03:21 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:03:21 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:03:21 user nova-compute[75285]:       <nova:name>tempest-TestVolumeSwap-server-989310564</nova:name>
Nov 10 21:03:21 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:03:21</nova:creationTime>
Nov 10 21:03:21 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:03:21 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:03:21 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:03:21 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:03:21 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:03:21 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:03:21 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:03:21 user nova-compute[75285]:       <nova:owner>
Nov 10 21:03:21 user nova-compute[75285]:         <nova:user uuid="225156b687544aa98c6fd6d0e5ba7c38">tempest-TestVolumeSwap-671625234-project-member</nova:user>
Nov 10 21:03:21 user nova-compute[75285]:         <nova:project uuid="5fbb80a67cb94284b19514d996fd0bb3">tempest-TestVolumeSwap-671625234</nova:project>
Nov 10 21:03:21 user nova-compute[75285]:       </nova:owner>
Nov 10 21:03:21 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:03:21 user nova-compute[75285]:       <nova:ports>
Nov 10 21:03:21 user nova-compute[75285]:         <nova:port uuid="996db12a-8c23-4a7e-91f4-e0f87358b2a6">
Nov 10 21:03:21 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 21:03:21 user nova-compute[75285]:         </nova:port>
Nov 10 21:03:21 user nova-compute[75285]:       </nova:ports>
Nov 10 21:03:21 user nova-compute[75285]:     </nova:instance>
Nov 10 21:03:21 user nova-compute[75285]:   </metadata>
Nov 10 21:03:21 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:03:21 user nova-compute[75285]:     <system>
Nov 10 21:03:21 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:03:21 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:03:21 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:03:21 user nova-compute[75285]:       <entry name="serial">8f6ad802-6f8f-42bc-95bd-934f4c9f55c3</entry>
Nov 10 21:03:21 user nova-compute[75285]:       <entry name="uuid">8f6ad802-6f8f-42bc-95bd-934f4c9f55c3</entry>
Nov 10 21:03:21 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:03:21 user nova-compute[75285]:     </system>
Nov 10 21:03:21 user nova-compute[75285]:   </sysinfo>
Nov 10 21:03:21 user nova-compute[75285]:   <os>
Nov 10 21:03:21 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:03:21 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:03:21 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:03:21 user nova-compute[75285]:   </os>
Nov 10 21:03:21 user nova-compute[75285]:   <features>
Nov 10 21:03:21 user nova-compute[75285]:     <acpi/>
Nov 10 21:03:21 user nova-compute[75285]:     <apic/>
Nov 10 21:03:21 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:03:21 user nova-compute[75285]:   </features>
Nov 10 21:03:21 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:03:21 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:03:21 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:03:21 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:03:21 user nova-compute[75285]:   </clock>
Nov 10 21:03:21 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:03:21 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:03:21 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:03:21 user nova-compute[75285]:   </cpu>
Nov 10 21:03:21 user nova-compute[75285]:   <devices>
Nov 10 21:03:21 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:03:21 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:03:21 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk"/>
Nov 10 21:03:21 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:03:21 user nova-compute[75285]:     </disk>
Nov 10 21:03:21 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:03:21 user nova-compute[75285]:       <mac address="fa:16:3e:1f:23:b7"/>
Nov 10 21:03:21 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:03:21 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:03:21 user nova-compute[75285]:       <target dev="tap996db12a-8c"/>
Nov 10 21:03:21 user nova-compute[75285]:     </interface>
Nov 10 21:03:21 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:03:21 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/console.log" append="off"/>
Nov 10 21:03:21 user nova-compute[75285]:     </serial>
Nov 10 21:03:21 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:03:21 user nova-compute[75285]:     <video>
Nov 10 21:03:21 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:03:21 user nova-compute[75285]:     </video>
Nov 10 21:03:21 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:03:21 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:03:21 user nova-compute[75285]:     </rng>
Nov 10 21:03:21 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:03:21 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:03:21 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:03:21 user nova-compute[75285]:     </memballoon>
Nov 10 21:03:21 user nova-compute[75285]:   </devices>
Nov 10 21:03:21 user nova-compute[75285]: </domain>
Nov 10 21:03:21 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-989310564',display_name='tempest-TestVolumeSwap-server-989310564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-989310564',id=7,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFY5NNWOUGwA9ea1DnxPF3BGBncJ2wpHoqKPwpsPxQv8U3ZCURja7QkDTcPO5mzDJXaZBy6nyIwfISM/9koc1orS/qxoGk5nUBE70vuuXz+brj6jqF2nHLXDrslPOX2vQ==',key_name='tempest-keypair-691951150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbb80a67cb94284b19514d996fd0bb3',ramdisk_id='',reservation_id='r-o2ny1w52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-671625234',owner_user_name='tempest-TestVolumeSwap-671625234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:03:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='225156b687544aa98c6fd6d0e5ba7c38',uuid=8f6ad802-6f8f-42bc-95bd-934f4c9f55c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "address": "fa:16:3e:1f:23:b7", "network": {"id": "10f7fc99-7b04-4985-b19e-fb751f9b528c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1893985114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb80a67cb94284b19514d996fd0bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996db12a-8c", "ovs_interfaceid": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Converting VIF {"id": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "address": "fa:16:3e:1f:23:b7", "network": {"id": "10f7fc99-7b04-4985-b19e-fb751f9b528c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1893985114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb80a67cb94284b19514d996fd0bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996db12a-8c", "ovs_interfaceid": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:23:b7,bridge_name='br-int',has_traffic_filtering=True,id=996db12a-8c23-4a7e-91f4-e0f87358b2a6,network=Network(10f7fc99-7b04-4985-b19e-fb751f9b528c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996db12a-8c') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG os_vif [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:23:b7,bridge_name='br-int',has_traffic_filtering=True,id=996db12a-8c23-4a7e-91f4-e0f87358b2a6,network=Network(10f7fc99-7b04-4985-b19e-fb751f9b528c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996db12a-8c') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d1ceb8c-d014-5eba-a420-0196140ec782', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap996db12a-8c, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap996db12a-8c, col_values=(('qos', UUID('4bd46a87-d314-4b49-925b-f87cfeeb0063')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap996db12a-8c, col_values=(('external_ids', {'iface-id': '996db12a-8c23-4a7e-91f4-e0f87358b2a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:23:b7', 'vm-uuid': '8f6ad802-6f8f-42bc-95bd-934f4c9f55c3'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:21 user nova-compute[75285]: INFO os_vif [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:23:b7,bridge_name='br-int',has_traffic_filtering=True,id=996db12a-8c23-4a7e-91f4-e0f87358b2a6,network=Network(10f7fc99-7b04-4985-b19e-fb751f9b528c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996db12a-8c')
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] No VIF found with MAC fa:16:3e:1f:23:b7, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:03:21 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Instance spawned successfully.
Nov 10 21:03:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:22 user nova-compute[75285]: INFO nova.compute.manager [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Took 8.51 seconds to spawn the instance on the hypervisor.
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.network.neutron [req-d53b681c-74ef-46c9-8a63-4a394561b338 req-158bf0e7-b0d6-4f22-9fcd-69e0c955bf03 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Updated VIF entry in instance network info cache for port 996db12a-8c23-4a7e-91f4-e0f87358b2a6. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.network.neutron [req-d53b681c-74ef-46c9-8a63-4a394561b338 req-158bf0e7-b0d6-4f22-9fcd-69e0c955bf03 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Updating instance_info_cache with network_info: [{"id": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "address": "fa:16:3e:1f:23:b7", "network": {"id": "10f7fc99-7b04-4985-b19e-fb751f9b528c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1893985114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb80a67cb94284b19514d996fd0bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996db12a-8c", "ovs_interfaceid": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d53b681c-74ef-46c9-8a63-4a394561b338 req-158bf0e7-b0d6-4f22-9fcd-69e0c955bf03 service nova] Releasing lock "refresh_cache-8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:03:22 user nova-compute[75285]: INFO nova.compute.manager [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Took 9.82 seconds to build instance.
Nov 10 21:03:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.726s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c33e5948-b589-4aa0-96ab-0c341c6c8472 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.048s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.network.neutron [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:03:22 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.policy [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3669c94227341edab384a4e1cb3020f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e29618f896244f999368b8e855e865b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:03:22 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Creating image(s)
Nov 10 21:03:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Acquiring lock "/opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "/opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "/opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.047s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.302s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.329s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk 1073741824" returned: 0 in 0.078s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.419s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.335s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json" returned: 0 in 0.333s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Cannot resize image /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Ensure instance console log exists: /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-d3b59be3-c9fc-440a-987f-69af66749a14 req-49841fbc-b32b-45ea-8fef-da3a01641963 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received event network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d3b59be3-c9fc-440a-987f-69af66749a14 req-49841fbc-b32b-45ea-8fef-da3a01641963 service nova] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d3b59be3-c9fc-440a-987f-69af66749a14 req-49841fbc-b32b-45ea-8fef-da3a01641963 service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d3b59be3-c9fc-440a-987f-69af66749a14 req-49841fbc-b32b-45ea-8fef-da3a01641963 service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-d3b59be3-c9fc-440a-987f-69af66749a14 req-49841fbc-b32b-45ea-8fef-da3a01641963 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] No waiting events found dispatching network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:03:24 user nova-compute[75285]: WARNING nova.compute.manager [req-d3b59be3-c9fc-440a-987f-69af66749a14 req-49841fbc-b32b-45ea-8fef-da3a01641963 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received unexpected event network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 for instance with vm_state building and task_state spawning.
Nov 10 21:03:24 user nova-compute[75285]: DEBUG nova.network.neutron [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Successfully created port: 5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:03:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.network.neutron [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Successfully updated port: 5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Acquiring lock "refresh_cache-82a83f12-0822-4cd0-8d1b-3f939a601745" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Acquired lock "refresh_cache-82a83f12-0822-4cd0-8d1b-3f939a601745" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.network.neutron [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.network.neutron [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.network.neutron [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Updating instance_info_cache with network_info: [{"id": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "address": "fa:16:3e:44:22:16", "network": {"id": "a71f1ce1-f597-4e04-8039-515b9c112b34", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1988900701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e29618f896244f999368b8e855e865b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ffcbc-ca", "ovs_interfaceid": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Releasing lock "refresh_cache-82a83f12-0822-4cd0-8d1b-3f939a601745" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.compute.manager [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Instance network_info: |[{"id": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "address": "fa:16:3e:44:22:16", "network": {"id": "a71f1ce1-f597-4e04-8039-515b9c112b34", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1988900701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e29618f896244f999368b8e855e865b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ffcbc-ca", "ovs_interfaceid": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Start _get_guest_xml network_info=[{"id": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "address": "fa:16:3e:44:22:16", "network": {"id": "a71f1ce1-f597-4e04-8039-515b9c112b34", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1988900701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e29618f896244f999368b8e855e865b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ffcbc-ca", "ovs_interfaceid": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:26 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:03:26 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-156470612',display_name='tempest-VolumesAssistedSnapshotsTest-server-156470612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-156470612',id=8,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZAzmjNrd7tQKKYQ3OAqfkoDjKuI8a4Ydc/MOzQNOoyoDXSTpAtv/pgPStZjWIiVzrm8OmQjSluMw0gSH1lf6ci2dE/ki4CkwQjTrCU0mSybjqPjoYSZDNfH3/V3JjIWg==',key_name='tempest-keypair-1941044813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e29618f896244f999368b8e855e865b',ramdisk_id='',reservation_id='r-yqm26z1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1283446631',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1283446631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:03:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3669c94227341edab384a4e1cb3020f',uuid=82a83f12-0822-4cd0-8d1b-3f939a601745,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "address": "fa:16:3e:44:22:16", "network": {"id": "a71f1ce1-f597-4e04-8039-515b9c112b34", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1988900701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e29618f896244f999368b8e855e865b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ffcbc-ca", "ovs_interfaceid": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Converting VIF {"id": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "address": "fa:16:3e:44:22:16", "network": {"id": "a71f1ce1-f597-4e04-8039-515b9c112b34", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1988900701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e29618f896244f999368b8e855e865b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ffcbc-ca", "ovs_interfaceid": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:22:16,bridge_name='br-int',has_traffic_filtering=True,id=5f6ffcbc-caa3-42c2-b73a-06ee4a95946b,network=Network(a71f1ce1-f597-4e04-8039-515b9c112b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6ffcbc-ca') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.objects.instance [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lazy-loading 'pci_devices' on Instance uuid 82a83f12-0822-4cd0-8d1b-3f939a601745 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-298e8801-2cad-4951-83ca-4090eee16ed1 req-721aed28-3fac-42f4-8fd6-60959887534e service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received event network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-298e8801-2cad-4951-83ca-4090eee16ed1 req-721aed28-3fac-42f4-8fd6-60959887534e service nova] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-298e8801-2cad-4951-83ca-4090eee16ed1 req-721aed28-3fac-42f4-8fd6-60959887534e service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-298e8801-2cad-4951-83ca-4090eee16ed1 req-721aed28-3fac-42f4-8fd6-60959887534e service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-298e8801-2cad-4951-83ca-4090eee16ed1 req-721aed28-3fac-42f4-8fd6-60959887534e service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] No waiting events found dispatching network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:03:26 user nova-compute[75285]: WARNING nova.compute.manager [req-298e8801-2cad-4951-83ca-4090eee16ed1 req-721aed28-3fac-42f4-8fd6-60959887534e service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received unexpected event network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 for instance with vm_state building and task_state spawning.
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-298e8801-2cad-4951-83ca-4090eee16ed1 req-721aed28-3fac-42f4-8fd6-60959887534e service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Received event network-changed-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-298e8801-2cad-4951-83ca-4090eee16ed1 req-721aed28-3fac-42f4-8fd6-60959887534e service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Refreshing instance network info cache due to event network-changed-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-298e8801-2cad-4951-83ca-4090eee16ed1 req-721aed28-3fac-42f4-8fd6-60959887534e service nova] Acquiring lock "refresh_cache-82a83f12-0822-4cd0-8d1b-3f939a601745" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-298e8801-2cad-4951-83ca-4090eee16ed1 req-721aed28-3fac-42f4-8fd6-60959887534e service nova] Acquired lock "refresh_cache-82a83f12-0822-4cd0-8d1b-3f939a601745" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.network.neutron [req-298e8801-2cad-4951-83ca-4090eee16ed1 req-721aed28-3fac-42f4-8fd6-60959887534e service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Refreshing network info cache for port 5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:03:26 user nova-compute[75285]:   <uuid>82a83f12-0822-4cd0-8d1b-3f939a601745</uuid>
Nov 10 21:03:26 user nova-compute[75285]:   <name>instance-00000008</name>
Nov 10 21:03:26 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:03:26 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:03:26 user nova-compute[75285]:   <metadata>
Nov 10 21:03:26 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:03:26 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:03:26 user nova-compute[75285]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-156470612</nova:name>
Nov 10 21:03:26 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:03:26</nova:creationTime>
Nov 10 21:03:26 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:03:26 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:03:26 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:03:26 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:03:26 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:03:26 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:03:26 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:03:26 user nova-compute[75285]:       <nova:owner>
Nov 10 21:03:26 user nova-compute[75285]:         <nova:user uuid="b3669c94227341edab384a4e1cb3020f">tempest-VolumesAssistedSnapshotsTest-1283446631-project-member</nova:user>
Nov 10 21:03:26 user nova-compute[75285]:         <nova:project uuid="2e29618f896244f999368b8e855e865b">tempest-VolumesAssistedSnapshotsTest-1283446631</nova:project>
Nov 10 21:03:26 user nova-compute[75285]:       </nova:owner>
Nov 10 21:03:26 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:03:26 user nova-compute[75285]:       <nova:ports>
Nov 10 21:03:26 user nova-compute[75285]:         <nova:port uuid="5f6ffcbc-caa3-42c2-b73a-06ee4a95946b">
Nov 10 21:03:26 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 21:03:26 user nova-compute[75285]:         </nova:port>
Nov 10 21:03:26 user nova-compute[75285]:       </nova:ports>
Nov 10 21:03:26 user nova-compute[75285]:     </nova:instance>
Nov 10 21:03:26 user nova-compute[75285]:   </metadata>
Nov 10 21:03:26 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:03:26 user nova-compute[75285]:     <system>
Nov 10 21:03:26 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:03:26 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:03:26 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:03:26 user nova-compute[75285]:       <entry name="serial">82a83f12-0822-4cd0-8d1b-3f939a601745</entry>
Nov 10 21:03:26 user nova-compute[75285]:       <entry name="uuid">82a83f12-0822-4cd0-8d1b-3f939a601745</entry>
Nov 10 21:03:26 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:03:26 user nova-compute[75285]:     </system>
Nov 10 21:03:26 user nova-compute[75285]:   </sysinfo>
Nov 10 21:03:26 user nova-compute[75285]:   <os>
Nov 10 21:03:26 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:03:26 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:03:26 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:03:26 user nova-compute[75285]:   </os>
Nov 10 21:03:26 user nova-compute[75285]:   <features>
Nov 10 21:03:26 user nova-compute[75285]:     <acpi/>
Nov 10 21:03:26 user nova-compute[75285]:     <apic/>
Nov 10 21:03:26 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:03:26 user nova-compute[75285]:   </features>
Nov 10 21:03:26 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:03:26 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:03:26 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:03:26 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:03:26 user nova-compute[75285]:   </clock>
Nov 10 21:03:26 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:03:26 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:03:26 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:03:26 user nova-compute[75285]:   </cpu>
Nov 10 21:03:26 user nova-compute[75285]:   <devices>
Nov 10 21:03:26 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:03:26 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:03:26 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk"/>
Nov 10 21:03:26 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:03:26 user nova-compute[75285]:     </disk>
Nov 10 21:03:26 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:03:26 user nova-compute[75285]:       <mac address="fa:16:3e:44:22:16"/>
Nov 10 21:03:26 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:03:26 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:03:26 user nova-compute[75285]:       <target dev="tap5f6ffcbc-ca"/>
Nov 10 21:03:26 user nova-compute[75285]:     </interface>
Nov 10 21:03:26 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:03:26 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/console.log" append="off"/>
Nov 10 21:03:26 user nova-compute[75285]:     </serial>
Nov 10 21:03:26 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:03:26 user nova-compute[75285]:     <video>
Nov 10 21:03:26 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:03:26 user nova-compute[75285]:     </video>
Nov 10 21:03:26 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:03:26 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:03:26 user nova-compute[75285]:     </rng>
Nov 10 21:03:26 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:03:26 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:03:26 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:03:26 user nova-compute[75285]:     </memballoon>
Nov 10 21:03:26 user nova-compute[75285]:   </devices>
Nov 10 21:03:26 user nova-compute[75285]: </domain>
Nov 10 21:03:26 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-156470612',display_name='tempest-VolumesAssistedSnapshotsTest-server-156470612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-156470612',id=8,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZAzmjNrd7tQKKYQ3OAqfkoDjKuI8a4Ydc/MOzQNOoyoDXSTpAtv/pgPStZjWIiVzrm8OmQjSluMw0gSH1lf6ci2dE/ki4CkwQjTrCU0mSybjqPjoYSZDNfH3/V3JjIWg==',key_name='tempest-keypair-1941044813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e29618f896244f999368b8e855e865b',ramdisk_id='',reservation_id='r-yqm26z1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1283446631',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1283446631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:03:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3669c94227341edab384a4e1cb3020f',uuid=82a83f12-0822-4cd0-8d1b-3f939a601745,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "address": "fa:16:3e:44:22:16", "network": {"id": "a71f1ce1-f597-4e04-8039-515b9c112b34", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1988900701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e29618f896244f999368b8e855e865b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ffcbc-ca", "ovs_interfaceid": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Converting VIF {"id": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "address": "fa:16:3e:44:22:16", "network": {"id": "a71f1ce1-f597-4e04-8039-515b9c112b34", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1988900701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e29618f896244f999368b8e855e865b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ffcbc-ca", "ovs_interfaceid": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:22:16,bridge_name='br-int',has_traffic_filtering=True,id=5f6ffcbc-caa3-42c2-b73a-06ee4a95946b,network=Network(a71f1ce1-f597-4e04-8039-515b9c112b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6ffcbc-ca') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG os_vif [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:22:16,bridge_name='br-int',has_traffic_filtering=True,id=5f6ffcbc-caa3-42c2-b73a-06ee4a95946b,network=Network(a71f1ce1-f597-4e04-8039-515b9c112b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6ffcbc-ca') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb672b8b-e381-524c-b67e-056d9de70107', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f6ffcbc-ca, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f6ffcbc-ca, col_values=(('qos', UUID('c08aec26-ed27-4d6d-84cf-097b8a11623b')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f6ffcbc-ca, col_values=(('external_ids', {'iface-id': '5f6ffcbc-caa3-42c2-b73a-06ee4a95946b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:22:16', 'vm-uuid': '82a83f12-0822-4cd0-8d1b-3f939a601745'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:26 user nova-compute[75285]: INFO os_vif [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:22:16,bridge_name='br-int',has_traffic_filtering=True,id=5f6ffcbc-caa3-42c2-b73a-06ee4a95946b,network=Network(a71f1ce1-f597-4e04-8039-515b9c112b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6ffcbc-ca')
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:03:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] No VIF found with MAC fa:16:3e:44:22:16, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:03:27 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:03:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:03:27 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Instance spawned successfully.
Nov 10 21:03:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:03:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:27 user nova-compute[75285]: INFO nova.compute.manager [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Took 9.34 seconds to spawn the instance on the hypervisor.
Nov 10 21:03:27 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:03:27 user nova-compute[75285]: DEBUG nova.network.neutron [req-298e8801-2cad-4951-83ca-4090eee16ed1 req-721aed28-3fac-42f4-8fd6-60959887534e service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Updated VIF entry in instance network info cache for port 5f6ffcbc-caa3-42c2-b73a-06ee4a95946b. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:03:27 user nova-compute[75285]: DEBUG nova.network.neutron [req-298e8801-2cad-4951-83ca-4090eee16ed1 req-721aed28-3fac-42f4-8fd6-60959887534e service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Updating instance_info_cache with network_info: [{"id": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "address": "fa:16:3e:44:22:16", "network": {"id": "a71f1ce1-f597-4e04-8039-515b9c112b34", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1988900701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e29618f896244f999368b8e855e865b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ffcbc-ca", "ovs_interfaceid": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:03:27 user nova-compute[75285]: INFO nova.compute.manager [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Took 10.75 seconds to build instance.
Nov 10 21:03:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-298e8801-2cad-4951-83ca-4090eee16ed1 req-721aed28-3fac-42f4-8fd6-60959887534e service nova] Releasing lock "refresh_cache-82a83f12-0822-4cd0-8d1b-3f939a601745" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:03:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5cbcaedf-390b-4695-aa87-cfd50618ff0a tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.044s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-58d78444-d1aa-4a1e-be32-fd421a13cf6b req-31cfc51f-7b48-44cc-9908-bfb58462cf1e service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Received event network-vif-plugged-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-58d78444-d1aa-4a1e-be32-fd421a13cf6b req-31cfc51f-7b48-44cc-9908-bfb58462cf1e service nova] Acquiring lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-58d78444-d1aa-4a1e-be32-fd421a13cf6b req-31cfc51f-7b48-44cc-9908-bfb58462cf1e service nova] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-58d78444-d1aa-4a1e-be32-fd421a13cf6b req-31cfc51f-7b48-44cc-9908-bfb58462cf1e service nova] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-58d78444-d1aa-4a1e-be32-fd421a13cf6b req-31cfc51f-7b48-44cc-9908-bfb58462cf1e service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] No waiting events found dispatching network-vif-plugged-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:03:29 user nova-compute[75285]: WARNING nova.compute.manager [req-58d78444-d1aa-4a1e-be32-fd421a13cf6b req-31cfc51f-7b48-44cc-9908-bfb58462cf1e service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Received unexpected event network-vif-plugged-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b for instance with vm_state building and task_state spawning.
Nov 10 21:03:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:03:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:03:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 21:03:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] There are 0 instances to clean {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 21:03:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:03:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances with incomplete migration  {{(pid=75285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 21:03:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:03:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG nova.compute.manager [req-41a2824a-65e4-412a-af1f-5625e8c34670 req-1d131d2f-8b6a-4046-820a-df66a4421269 service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Received event network-vif-plugged-6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-41a2824a-65e4-412a-af1f-5625e8c34670 req-1d131d2f-8b6a-4046-820a-df66a4421269 service nova] Acquiring lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-41a2824a-65e4-412a-af1f-5625e8c34670 req-1d131d2f-8b6a-4046-820a-df66a4421269 service nova] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-41a2824a-65e4-412a-af1f-5625e8c34670 req-1d131d2f-8b6a-4046-820a-df66a4421269 service nova] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG nova.compute.manager [req-41a2824a-65e4-412a-af1f-5625e8c34670 req-1d131d2f-8b6a-4046-820a-df66a4421269 service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] No waiting events found dispatching network-vif-plugged-6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:03:31 user nova-compute[75285]: WARNING nova.compute.manager [req-41a2824a-65e4-412a-af1f-5625e8c34670 req-1d131d2f-8b6a-4046-820a-df66a4421269 service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Received unexpected event network-vif-plugged-6335c90a-8b5b-4619-af6f-e420972d35d0 for instance with vm_state active and task_state None.
Nov 10 21:03:31 user nova-compute[75285]: DEBUG nova.compute.manager [req-f6dd9d47-16e1-4f8d-b2cc-6a865ee01c08 req-d0ac5557-2ac7-4165-9aa3-f02fc21e6e7d service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Received event network-vif-plugged-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f6dd9d47-16e1-4f8d-b2cc-6a865ee01c08 req-d0ac5557-2ac7-4165-9aa3-f02fc21e6e7d service nova] Acquiring lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f6dd9d47-16e1-4f8d-b2cc-6a865ee01c08 req-d0ac5557-2ac7-4165-9aa3-f02fc21e6e7d service nova] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f6dd9d47-16e1-4f8d-b2cc-6a865ee01c08 req-d0ac5557-2ac7-4165-9aa3-f02fc21e6e7d service nova] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG nova.compute.manager [req-f6dd9d47-16e1-4f8d-b2cc-6a865ee01c08 req-d0ac5557-2ac7-4165-9aa3-f02fc21e6e7d service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] No waiting events found dispatching network-vif-plugged-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:03:31 user nova-compute[75285]: WARNING nova.compute.manager [req-f6dd9d47-16e1-4f8d-b2cc-6a865ee01c08 req-d0ac5557-2ac7-4165-9aa3-f02fc21e6e7d service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Received unexpected event network-vif-plugged-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b for instance with vm_state building and task_state spawning.
Nov 10 21:03:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:03:31 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Instance spawned successfully.
Nov 10 21:03:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:03:31 user nova-compute[75285]: INFO nova.compute.manager [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Took 8.97 seconds to spawn the instance on the hypervisor.
Nov 10 21:03:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:03:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:32 user nova-compute[75285]: INFO nova.compute.manager [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Took 10.49 seconds to build instance.
Nov 10 21:03:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-98654016-61c5-4cb5-ae9c-b252c99db511 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.658s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:32 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:03:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-e421b82c-1bad-4d3b-b25c-2aff45ade6f9 req-fe97ebdd-60b4-4433-8753-f4695ee0fa91 service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Received event network-vif-plugged-6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e421b82c-1bad-4d3b-b25c-2aff45ade6f9 req-fe97ebdd-60b4-4433-8753-f4695ee0fa91 service nova] Acquiring lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e421b82c-1bad-4d3b-b25c-2aff45ade6f9 req-fe97ebdd-60b4-4433-8753-f4695ee0fa91 service nova] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e421b82c-1bad-4d3b-b25c-2aff45ade6f9 req-fe97ebdd-60b4-4433-8753-f4695ee0fa91 service nova] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-e421b82c-1bad-4d3b-b25c-2aff45ade6f9 req-fe97ebdd-60b4-4433-8753-f4695ee0fa91 service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] No waiting events found dispatching network-vif-plugged-6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:03:33 user nova-compute[75285]: WARNING nova.compute.manager [req-e421b82c-1bad-4d3b-b25c-2aff45ade6f9 req-fe97ebdd-60b4-4433-8753-f4695ee0fa91 service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Received unexpected event network-vif-plugged-6335c90a-8b5b-4619-af6f-e420972d35d0 for instance with vm_state active and task_state None.
Nov 10 21:03:34 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:03:34 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:03:34 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:03:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:34 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:03:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-51f5bfff-c948-444d-85fe-27e51e417e50 req-465cc237-ba0c-4b3a-bd21-0271f129f581 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Received event network-vif-plugged-9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-51f5bfff-c948-444d-85fe-27e51e417e50 req-465cc237-ba0c-4b3a-bd21-0271f129f581 service nova] Acquiring lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-51f5bfff-c948-444d-85fe-27e51e417e50 req-465cc237-ba0c-4b3a-bd21-0271f129f581 service nova] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-51f5bfff-c948-444d-85fe-27e51e417e50 req-465cc237-ba0c-4b3a-bd21-0271f129f581 service nova] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-51f5bfff-c948-444d-85fe-27e51e417e50 req-465cc237-ba0c-4b3a-bd21-0271f129f581 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] No waiting events found dispatching network-vif-plugged-9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:03:37 user nova-compute[75285]: WARNING nova.compute.manager [req-51f5bfff-c948-444d-85fe-27e51e417e50 req-465cc237-ba0c-4b3a-bd21-0271f129f581 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Received unexpected event network-vif-plugged-9179b028-23d4-4b6e-bac0-9df516cc9dfe for instance with vm_state active and task_state None.
Nov 10 21:03:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:03:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Received event network-vif-plugged-9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] Acquiring lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] No waiting events found dispatching network-vif-plugged-9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:03:39 user nova-compute[75285]: WARNING nova.compute.manager [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Received unexpected event network-vif-plugged-9179b028-23d4-4b6e-bac0-9df516cc9dfe for instance with vm_state active and task_state None.
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received event network-vif-plugged-46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] Acquiring lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] No waiting events found dispatching network-vif-plugged-46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:03:39 user nova-compute[75285]: WARNING nova.compute.manager [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received unexpected event network-vif-plugged-46353ed3-1736-493a-99b8-580504a9abc9 for instance with vm_state active and task_state None.
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received event network-vif-plugged-46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] Acquiring lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] No waiting events found dispatching network-vif-plugged-46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:03:39 user nova-compute[75285]: WARNING nova.compute.manager [req-fec46be3-6117-4728-9848-fb8e8ab48f75 req-6a35c361-3bdb-4993-8aeb-fa1ebbb400f1 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received unexpected event network-vif-plugged-46353ed3-1736-493a-99b8-580504a9abc9 for instance with vm_state active and task_state None.
Nov 10 21:03:39 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:03:39 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7821MB free_disk=25.57574462890625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 02b4446d-1538-4e80-b93d-5cb904b7b98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 6db680e7-3e21-4451-a0b1-29f9eca59b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ec5dca1b-b623-4a12-af56-aa2bce208869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 431a5e3b-068c-4da3-8198-85b4dcafd266 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 82a83f12-0822-4cd0-8d1b-3f939a601745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing inventories for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating ProviderTree inventory for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating inventory in ProviderTree for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing aggregate associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, aggregates: None {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 21:03:39 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing trait associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 21:03:40 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:03:40 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:03:40 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:03:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.887s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:03:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:41 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:03:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:03:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:03:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:03:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:03:41 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:03:41 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid 16f56b6b-f08d-4650-b0eb-a202662b0eb6 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:03:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:41 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Updating instance_info_cache with network_info: [{"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:03:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:03:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:03:41 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:03:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:03:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:04:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:04:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:04:30 user nova-compute[75285]: INFO nova.compute.manager [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Rescuing
Nov 10 21:04:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquired lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:30 user nova-compute[75285]: DEBUG nova.network.neutron [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:04:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:30 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:04:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:30 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:04:30 user nova-compute[75285]: INFO nova.compute.claims [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Claim successful on node user
Nov 10 21:04:30 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:04:30 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:04:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:04:30 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:04:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:04:31 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:04:31 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:04:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:04:31 user nova-compute[75285]: INFO nova.virt.block_device [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Booting with volume 6eae897f-a431-47f8-a064-f82680de5b89 at /dev/vda
Nov 10 21:04:31 user nova-compute[75285]: DEBUG nova.policy [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14517e31ebb14b2aa08eaa4c7903cf75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8ea660e66943cca0d07c83d14612c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:04:31 user nova-compute[75285]: DEBUG os_brick.utils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:04:31 user nova-compute[75285]: INFO oslo.privsep.daemon [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp3byjd3ot/privsep.sock']
Nov 10 21:04:31 user sudo[86378]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp3byjd3ot/privsep.sock
Nov 10 21:04:31 user sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 21:04:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:04:31 user nova-compute[75285]: DEBUG nova.network.neutron [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Updating instance_info_cache with network_info: [{"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:31 user nova-compute[75285]: DEBUG nova.compute.manager [req-1c8d973e-bd7f-431b-b0fd-cafe40be80e3 req-b76579c4-df55-46d3-a786-249db0317d31 service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Received event network-changed-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:31 user nova-compute[75285]: DEBUG nova.compute.manager [req-1c8d973e-bd7f-431b-b0fd-cafe40be80e3 req-b76579c4-df55-46d3-a786-249db0317d31 service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Refreshing instance network info cache due to event network-changed-86d6abc5-af6c-4a7a-be0c-81dc149b5df7. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:04:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1c8d973e-bd7f-431b-b0fd-cafe40be80e3 req-b76579c4-df55-46d3-a786-249db0317d31 service nova] Acquiring lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1c8d973e-bd7f-431b-b0fd-cafe40be80e3 req-b76579c4-df55-46d3-a786-249db0317d31 service nova] Acquired lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:31 user nova-compute[75285]: DEBUG nova.network.neutron [req-1c8d973e-bd7f-431b-b0fd-cafe40be80e3 req-b76579c4-df55-46d3-a786-249db0317d31 service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Refreshing network info cache for port 86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:04:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Releasing lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.network.neutron [req-1c8d973e-bd7f-431b-b0fd-cafe40be80e3 req-b76579c4-df55-46d3-a786-249db0317d31 service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Updated VIF entry in instance network info cache for port 86d6abc5-af6c-4a7a-be0c-81dc149b5df7. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.network.neutron [req-1c8d973e-bd7f-431b-b0fd-cafe40be80e3 req-b76579c4-df55-46d3-a786-249db0317d31 service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Updating instance_info_cache with network_info: [{"id": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "address": "fa:16:3e:d6:59:09", "network": {"id": "bb78092d-2ba8-42bd-862e-b697ef77a6ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958013330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d223d68b26463c93d4c8f203d5d597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d6abc5-af", "ovs_interfaceid": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1c8d973e-bd7f-431b-b0fd-cafe40be80e3 req-b76579c4-df55-46d3-a786-249db0317d31 service nova] Releasing lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.compute.manager [req-50b1e0f0-cc1d-45b3-976c-95170bc6a07e req-505669b6-65ac-4929-b3b8-d0a41f23a033 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received event network-vif-unplugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-50b1e0f0-cc1d-45b3-976c-95170bc6a07e req-505669b6-65ac-4929-b3b8-d0a41f23a033 service nova] Acquiring lock "62e8cc12-802e-415c-a166-4590715372c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-50b1e0f0-cc1d-45b3-976c-95170bc6a07e req-505669b6-65ac-4929-b3b8-d0a41f23a033 service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-50b1e0f0-cc1d-45b3-976c-95170bc6a07e req-505669b6-65ac-4929-b3b8-d0a41f23a033 service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.compute.manager [req-50b1e0f0-cc1d-45b3-976c-95170bc6a07e req-505669b6-65ac-4929-b3b8-d0a41f23a033 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] No waiting events found dispatching network-vif-unplugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:04:32 user nova-compute[75285]: WARNING nova.compute.manager [req-50b1e0f0-cc1d-45b3-976c-95170bc6a07e req-505669b6-65ac-4929-b3b8-d0a41f23a033 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received unexpected event network-vif-unplugged-87b7f663-4936-4a68-b667-7097b5b46783 for instance with vm_state active and task_state rescuing.
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Successfully created port: 99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:04:32 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Instance destroyed successfully.
Nov 10 21:04:32 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Attempting rescue
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75285) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Instance directory exists: not creating {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 21:04:32 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Creating image(s)
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "/opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "/opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "/opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.objects.instance [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'trusted_certs' on Instance uuid 62e8cc12-802e-415c-a166-4590715372c5 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.228s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue" returned: 0 in 0.054s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.objects.instance [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'migration_context' on Instance uuid 62e8cc12-802e-415c-a166-4590715372c5 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.objects.base [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<62e8cc12-802e-415c-a166-4590715372c5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Start _get_guest_xml network_info=[{"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "vif_mac": "fa:16:3e:32:86:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.objects.instance [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'resources' on Instance uuid 62e8cc12-802e-415c-a166-4590715372c5 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.objects.base [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<62e8cc12-802e-415c-a166-4590715372c5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.objects.instance [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'numa_topology' on Instance uuid 62e8cc12-802e-415c-a166-4590715372c5 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.objects.base [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<62e8cc12-802e-415c-a166-4590715372c5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:04:32 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:04:32 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.objects.instance [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'vcpu_model' on Instance uuid 62e8cc12-802e-415c-a166-4590715372c5 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.objects.base [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<62e8cc12-802e-415c-a166-4590715372c5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1706581524',display_name='tempest-ServerRescueNegativeTestJSON-server-1706581524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1706581524',id=3,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:02:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44979c0f5b7d4205a0e5e0becbe714cb',ramdisk_id='',reservation_id='r-ybxi4o1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-418662944',owner_user_name='tempest-ServerRescueNegativeTestJSON-418662944-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:02:56Z,user_data=None,user_id='b9c20460877a428e9fa97869ba34eb04',uuid=62e8cc12-802e-415c-a166-4590715372c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "vif_mac": "fa:16:3e:32:86:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converting VIF {"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "vif_mac": "fa:16:3e:32:86:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:86:43,bridge_name='br-int',has_traffic_filtering=True,id=87b7f663-4936-4a68-b667-7097b5b46783,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b7f663-49') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:04:32 user nova-compute[75285]: DEBUG nova.objects.instance [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'pci_devices' on Instance uuid 62e8cc12-802e-415c-a166-4590715372c5 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG nova.objects.base [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<62e8cc12-802e-415c-a166-4590715372c5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:04:33 user nova-compute[75285]:   <uuid>62e8cc12-802e-415c-a166-4590715372c5</uuid>
Nov 10 21:04:33 user nova-compute[75285]:   <name>instance-00000003</name>
Nov 10 21:04:33 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:04:33 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:04:33 user nova-compute[75285]:   <metadata>
Nov 10 21:04:33 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:04:33 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:04:33 user nova-compute[75285]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1706581524</nova:name>
Nov 10 21:04:33 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:04:32</nova:creationTime>
Nov 10 21:04:33 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:04:33 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:04:33 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:04:33 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:04:33 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:04:33 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:04:33 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:04:33 user nova-compute[75285]:       <nova:owner>
Nov 10 21:04:33 user nova-compute[75285]:         <nova:user uuid="b9c20460877a428e9fa97869ba34eb04">tempest-ServerRescueNegativeTestJSON-418662944-project-member</nova:user>
Nov 10 21:04:33 user nova-compute[75285]:         <nova:project uuid="44979c0f5b7d4205a0e5e0becbe714cb">tempest-ServerRescueNegativeTestJSON-418662944</nova:project>
Nov 10 21:04:33 user nova-compute[75285]:       </nova:owner>
Nov 10 21:04:33 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:04:33 user nova-compute[75285]:       <nova:ports>
Nov 10 21:04:33 user nova-compute[75285]:         <nova:port uuid="87b7f663-4936-4a68-b667-7097b5b46783">
Nov 10 21:04:33 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 21:04:33 user nova-compute[75285]:         </nova:port>
Nov 10 21:04:33 user nova-compute[75285]:       </nova:ports>
Nov 10 21:04:33 user nova-compute[75285]:     </nova:instance>
Nov 10 21:04:33 user nova-compute[75285]:   </metadata>
Nov 10 21:04:33 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:04:33 user nova-compute[75285]:     <system>
Nov 10 21:04:33 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:04:33 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:04:33 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:04:33 user nova-compute[75285]:       <entry name="serial">62e8cc12-802e-415c-a166-4590715372c5</entry>
Nov 10 21:04:33 user nova-compute[75285]:       <entry name="uuid">62e8cc12-802e-415c-a166-4590715372c5</entry>
Nov 10 21:04:33 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:04:33 user nova-compute[75285]:     </system>
Nov 10 21:04:33 user nova-compute[75285]:   </sysinfo>
Nov 10 21:04:33 user nova-compute[75285]:   <os>
Nov 10 21:04:33 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:04:33 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:04:33 user nova-compute[75285]:   </os>
Nov 10 21:04:33 user nova-compute[75285]:   <features>
Nov 10 21:04:33 user nova-compute[75285]:     <acpi/>
Nov 10 21:04:33 user nova-compute[75285]:     <apic/>
Nov 10 21:04:33 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:04:33 user nova-compute[75285]:   </features>
Nov 10 21:04:33 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:04:33 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:04:33 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:04:33 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:04:33 user nova-compute[75285]:   </clock>
Nov 10 21:04:33 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:04:33 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:04:33 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:04:33 user nova-compute[75285]:   </cpu>
Nov 10 21:04:33 user nova-compute[75285]:   <devices>
Nov 10 21:04:33 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:04:33 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:04:33 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue"/>
Nov 10 21:04:33 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:04:33 user nova-compute[75285]:     </disk>
Nov 10 21:04:33 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:04:33 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:04:33 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk"/>
Nov 10 21:04:33 user nova-compute[75285]:       <target dev="vdb" bus="virtio"/>
Nov 10 21:04:33 user nova-compute[75285]:     </disk>
Nov 10 21:04:33 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:04:33 user nova-compute[75285]:       <mac address="fa:16:3e:32:86:43"/>
Nov 10 21:04:33 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:04:33 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:04:33 user nova-compute[75285]:       <target dev="tap87b7f663-49"/>
Nov 10 21:04:33 user nova-compute[75285]:     </interface>
Nov 10 21:04:33 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:04:33 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/console.log" append="off"/>
Nov 10 21:04:33 user nova-compute[75285]:     </serial>
Nov 10 21:04:33 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:04:33 user nova-compute[75285]:     <video>
Nov 10 21:04:33 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:04:33 user nova-compute[75285]:     </video>
Nov 10 21:04:33 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:04:33 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:04:33 user nova-compute[75285]:     </rng>
Nov 10 21:04:33 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:04:33 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:04:33 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:04:33 user nova-compute[75285]:     </memballoon>
Nov 10 21:04:33 user nova-compute[75285]:   </devices>
Nov 10 21:04:33 user nova-compute[75285]: </domain>
Nov 10 21:04:33 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:04:33 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Instance destroyed successfully.
Nov 10 21:04:33 user sudo[86378]: pam_unix(sudo:session): session closed for user root
Nov 10 21:04:33 user nova-compute[75285]: INFO oslo.privsep.daemon [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Spawned new privsep daemon via rootwrap
Nov 10 21:04:33 user nova-compute[75285]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 21:04:33 user nova-compute[75285]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 21:04:33 user nova-compute[75285]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 10 21:04:33 user nova-compute[75285]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86427
Nov 10 21:04:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No VIF found with MAC fa:16:3e:32:86:43, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6b049a-7a11-4d6e-a487-820011db9d74]: (2,) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Successfully created port: fb6c95f2-fe2f-488b-8119-6cc8158f90a5 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d46789-bc7b-465f-b6fd-cc14f6a78f28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:04:33 user nova-compute[75285]: WARNING os_brick.initiator.connectors.nvmeof [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[510ac854-e1b5-4a38-94b8-3fb0a80bee8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd216d6-f565-41a7-9b92-c13df18e8cbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eae867-16fd-4ac7-a5ff-bcdeed8bdd73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:04:33 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8608f59-db0a-411b-89d9-ec8ac908d1de]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG os_brick.utils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] <== get_connector_properties: return (1950ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updating existing volume attachment record: 7a8420b0-9536-4ca4-b826-94bb16f15a10 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:04:33 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Successfully created port: 3ee974a9-ab23-4c8b-99c3-3e0823cccfaf {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Successfully created port: ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-aa68013f-b791-4522-95fc-be90f93ca401 req-a10c17dc-fc27-43c7-a42f-eaa0940e44bd service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received event network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-aa68013f-b791-4522-95fc-be90f93ca401 req-a10c17dc-fc27-43c7-a42f-eaa0940e44bd service nova] Acquiring lock "62e8cc12-802e-415c-a166-4590715372c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-aa68013f-b791-4522-95fc-be90f93ca401 req-a10c17dc-fc27-43c7-a42f-eaa0940e44bd service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-aa68013f-b791-4522-95fc-be90f93ca401 req-a10c17dc-fc27-43c7-a42f-eaa0940e44bd service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-aa68013f-b791-4522-95fc-be90f93ca401 req-a10c17dc-fc27-43c7-a42f-eaa0940e44bd service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] No waiting events found dispatching network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:04:34 user nova-compute[75285]: WARNING nova.compute.manager [req-aa68013f-b791-4522-95fc-be90f93ca401 req-a10c17dc-fc27-43c7-a42f-eaa0940e44bd service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received unexpected event network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 for instance with vm_state active and task_state rescuing.
Nov 10 21:04:34 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:35 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Successfully created port: 875dac5e-5dc7-45f9-befe-a128379298e1 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:04:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:35 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Successfully updated port: 99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received event network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] Acquiring lock "62e8cc12-802e-415c-a166-4590715372c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] No waiting events found dispatching network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:04:36 user nova-compute[75285]: WARNING nova.compute.manager [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received unexpected event network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 for instance with vm_state active and task_state rescuing.
Nov 10 21:04:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received event network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] Acquiring lock "62e8cc12-802e-415c-a166-4590715372c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] No waiting events found dispatching network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:04:36 user nova-compute[75285]: WARNING nova.compute.manager [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received unexpected event network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 for instance with vm_state active and task_state rescuing.
Nov 10 21:04:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-changed-99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing instance network info cache due to event network-changed-99435856-9d26-448e-87de-b0ca7e110d7e. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] Acquiring lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] Acquired lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG nova.network.neutron [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing network info cache for port 99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG nova.network.neutron [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Successfully updated port: a285a3dc-41b1-41f5-8f7f-693f74e288ad {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:36 user nova-compute[75285]: DEBUG nova.network.neutron [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-10f138cf-0380-414b-a431-34e70f00a655 req-83d5aa1a-3f5e-449f-a222-53957052bbd4 service nova] Releasing lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-be76e612-1e5b-4007-8a0f-4edf3b9943f7 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:04:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:37 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Successfully updated port: 007fd357-2314-47ad-9e02-0e30f5e6dd09 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:04:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-changed-a285a3dc-41b1-41f5-8f7f-693f74e288ad {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing instance network info cache due to event network-changed-a285a3dc-41b1-41f5-8f7f-693f74e288ad. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] Acquiring lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] Acquired lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG nova.network.neutron [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing network info cache for port a285a3dc-41b1-41f5-8f7f-693f74e288ad {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG nova.network.neutron [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Successfully updated port: fb6c95f2-fe2f-488b-8119-6cc8158f90a5 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG nova.network.neutron [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] Releasing lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-changed-007fd357-2314-47ad-9e02-0e30f5e6dd09 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing instance network info cache due to event network-changed-007fd357-2314-47ad-9e02-0e30f5e6dd09. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] Acquiring lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] Acquired lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG nova.network.neutron [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing network info cache for port 007fd357-2314-47ad-9e02-0e30f5e6dd09 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG nova.network.neutron [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG nova.network.neutron [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1b1b57b9-6dfb-4f3a-834c-13b9ab630492 req-d43341e2-dd8e-490e-b782-7844287f9232 service nova] Releasing lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Successfully updated port: 3ee974a9-ab23-4c8b-99c3-3e0823cccfaf {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-changed-fb6c95f2-fe2f-488b-8119-6cc8158f90a5 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing instance network info cache due to event network-changed-fb6c95f2-fe2f-488b-8119-6cc8158f90a5. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] Acquiring lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] Acquired lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG nova.network.neutron [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing network info cache for port fb6c95f2-fe2f-488b-8119-6cc8158f90a5 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:40 user nova-compute[75285]: DEBUG nova.network.neutron [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:04:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:41 user nova-compute[75285]: DEBUG nova.network.neutron [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] Releasing lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-changed-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing instance network info cache due to event network-changed-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:04:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] Acquiring lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] Acquired lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:41 user nova-compute[75285]: DEBUG nova.network.neutron [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing network info cache for port 3ee974a9-ab23-4c8b-99c3-3e0823cccfaf {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:04:41 user nova-compute[75285]: DEBUG nova.network.neutron [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:04:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:41 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Successfully updated port: ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:04:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.network.neutron [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:42 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:04:42 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7576MB free_disk=25.468841552734375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7d65f79c-939c-476f-af24-1dea9ad461d7 req-2015e009-769e-4750-be8a-c599580c51b3 service nova] Releasing lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 02b4446d-1538-4e80-b93d-5cb904b7b98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 6db680e7-3e21-4451-a0b1-29f9eca59b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ec5dca1b-b623-4a12-af56-aa2bce208869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 431a5e3b-068c-4da3-8198-85b4dcafd266 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 82a83f12-0822-4cd0-8d1b-3f939a601745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance aa74d6a6-3084-45c9-b15a-2b831077a3ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Successfully updated port: 875dac5e-5dc7-45f9-befe-a128379298e1 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquired lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.manager [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-changed-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG nova.compute.manager [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing instance network info cache due to event network-changed-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] Acquiring lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:43 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:04:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:04:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:43 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:04:44 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Updating instance_info_cache with network_info: [{"id": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "address": "fa:16:3e:d6:59:09", "network": {"id": "bb78092d-2ba8-42bd-862e-b697ef77a6ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958013330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d223d68b26463c93d4c8f203d5d597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d6abc5-af", "ovs_interfaceid": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:04:44 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:04:44 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:04:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:04:45 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updating instance_info_cache with network_info: [{"id": "99435856-9d26-448e-87de-b0ca7e110d7e", "address": "fa:16:3e:fe:af:16", "network": {"id": "50305b49-f0da-4a31-aa59-afec3d63b685", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2066917041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99435856-9d", "ovs_interfaceid": "99435856-9d26-448e-87de-b0ca7e110d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "address": "fa:16:3e:c9:0b:3c", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa285a3dc-41", "ovs_interfaceid": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "address": "fa:16:3e:17:7f:91", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007fd357-23", "ovs_interfaceid": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "address": "fa:16:3e:f3:38:05", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6c95f2-fe", "ovs_interfaceid": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "address": "fa:16:3e:41:2d:eb", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee974a9-ab", "ovs_interfaceid": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "address": "fa:16:3e:36:9a:af", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef2795ba-d5", "ovs_interfaceid": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "875dac5e-5dc7-45f9-befe-a128379298e1", "address": "fa:16:3e:98:b0:ab", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875dac5e-5d", "ovs_interfaceid": "875dac5e-5dc7-45f9-befe-a128379298e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Releasing lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:45 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Instance network_info: |[{"id": "99435856-9d26-448e-87de-b0ca7e110d7e", "address": "fa:16:3e:fe:af:16", "network": {"id": "50305b49-f0da-4a31-aa59-afec3d63b685", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2066917041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99435856-9d", "ovs_interfaceid": "99435856-9d26-448e-87de-b0ca7e110d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "address": "fa:16:3e:c9:0b:3c", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa285a3dc-41", "ovs_interfaceid": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "address": "fa:16:3e:17:7f:91", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007fd357-23", "ovs_interfaceid": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "address": "fa:16:3e:f3:38:05", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6c95f2-fe", "ovs_interfaceid": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "address": "fa:16:3e:41:2d:eb", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee974a9-ab", "ovs_interfaceid": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "address": "fa:16:3e:36:9a:af", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef2795ba-d5", "ovs_interfaceid": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "875dac5e-5dc7-45f9-befe-a128379298e1", "address": "fa:16:3e:98:b0:ab", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875dac5e-5d", "ovs_interfaceid": "875dac5e-5dc7-45f9-befe-a128379298e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:04:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] Acquired lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:45 user nova-compute[75285]: DEBUG nova.network.neutron [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing network info cache for port ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:04:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:46 user nova-compute[75285]: DEBUG nova.network.neutron [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updated VIF entry in instance network info cache for port ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:04:46 user nova-compute[75285]: DEBUG nova.network.neutron [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updating instance_info_cache with network_info: [{"id": "99435856-9d26-448e-87de-b0ca7e110d7e", "address": "fa:16:3e:fe:af:16", "network": {"id": "50305b49-f0da-4a31-aa59-afec3d63b685", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2066917041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99435856-9d", "ovs_interfaceid": "99435856-9d26-448e-87de-b0ca7e110d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "address": "fa:16:3e:c9:0b:3c", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa285a3dc-41", "ovs_interfaceid": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "address": "fa:16:3e:17:7f:91", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007fd357-23", "ovs_interfaceid": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "address": "fa:16:3e:f3:38:05", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6c95f2-fe", "ovs_interfaceid": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "address": "fa:16:3e:41:2d:eb", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee974a9-ab", "ovs_interfaceid": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "address": "fa:16:3e:36:9a:af", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef2795ba-d5", "ovs_interfaceid": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "875dac5e-5dc7-45f9-befe-a128379298e1", "address": "fa:16:3e:98:b0:ab", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875dac5e-5d", "ovs_interfaceid": "875dac5e-5dc7-45f9-befe-a128379298e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] Releasing lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-changed-875dac5e-5dc7-45f9-befe-a128379298e1 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing instance network info cache due to event network-changed-875dac5e-5dc7-45f9-befe-a128379298e1. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:04:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] Acquiring lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] Acquired lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:46 user nova-compute[75285]: DEBUG nova.network.neutron [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing network info cache for port 875dac5e-5dc7-45f9-befe-a128379298e1 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:04:46 user nova-compute[75285]: DEBUG nova.network.neutron [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updated VIF entry in instance network info cache for port 875dac5e-5dc7-45f9-befe-a128379298e1. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:04:46 user nova-compute[75285]: DEBUG nova.network.neutron [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updating instance_info_cache with network_info: [{"id": "99435856-9d26-448e-87de-b0ca7e110d7e", "address": "fa:16:3e:fe:af:16", "network": {"id": "50305b49-f0da-4a31-aa59-afec3d63b685", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2066917041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99435856-9d", "ovs_interfaceid": "99435856-9d26-448e-87de-b0ca7e110d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "address": "fa:16:3e:c9:0b:3c", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa285a3dc-41", "ovs_interfaceid": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "address": "fa:16:3e:17:7f:91", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007fd357-23", "ovs_interfaceid": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "address": "fa:16:3e:f3:38:05", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6c95f2-fe", "ovs_interfaceid": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "address": "fa:16:3e:41:2d:eb", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee974a9-ab", "ovs_interfaceid": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "address": "fa:16:3e:36:9a:af", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef2795ba-d5", "ovs_interfaceid": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "875dac5e-5dc7-45f9-befe-a128379298e1", "address": "fa:16:3e:98:b0:ab", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875dac5e-5d", "ovs_interfaceid": "875dac5e-5dc7-45f9-befe-a128379298e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-912fae53-3bf4-44e9-9b98-09836afb2c7d req-45368b05-1de2-4d45-ae4b-7fc23a18e090 service nova] Releasing lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:48 user nova-compute[75285]: DEBUG nova.compute.manager [req-fca7c903-d61d-43aa-ba1b-b9794f9117a4 req-51a6ddf1-91d1-427b-8d08-4bb7ec668f74 service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Received event network-changed-6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:48 user nova-compute[75285]: DEBUG nova.compute.manager [req-fca7c903-d61d-43aa-ba1b-b9794f9117a4 req-51a6ddf1-91d1-427b-8d08-4bb7ec668f74 service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Refreshing instance network info cache due to event network-changed-6335c90a-8b5b-4619-af6f-e420972d35d0. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:04:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fca7c903-d61d-43aa-ba1b-b9794f9117a4 req-51a6ddf1-91d1-427b-8d08-4bb7ec668f74 service nova] Acquiring lock "refresh_cache-6db680e7-3e21-4451-a0b1-29f9eca59b2f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fca7c903-d61d-43aa-ba1b-b9794f9117a4 req-51a6ddf1-91d1-427b-8d08-4bb7ec668f74 service nova] Acquired lock "refresh_cache-6db680e7-3e21-4451-a0b1-29f9eca59b2f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:48 user nova-compute[75285]: DEBUG nova.network.neutron [req-fca7c903-d61d-43aa-ba1b-b9794f9117a4 req-51a6ddf1-91d1-427b-8d08-4bb7ec668f74 service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Refreshing network info cache for port 6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:04:49 user nova-compute[75285]: DEBUG nova.network.neutron [req-fca7c903-d61d-43aa-ba1b-b9794f9117a4 req-51a6ddf1-91d1-427b-8d08-4bb7ec668f74 service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Updated VIF entry in instance network info cache for port 6335c90a-8b5b-4619-af6f-e420972d35d0. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:04:49 user nova-compute[75285]: DEBUG nova.network.neutron [req-fca7c903-d61d-43aa-ba1b-b9794f9117a4 req-51a6ddf1-91d1-427b-8d08-4bb7ec668f74 service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Updating instance_info_cache with network_info: [{"id": "6335c90a-8b5b-4619-af6f-e420972d35d0", "address": "fa:16:3e:9b:b6:31", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6335c90a-8b", "ovs_interfaceid": "6335c90a-8b5b-4619-af6f-e420972d35d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fca7c903-d61d-43aa-ba1b-b9794f9117a4 req-51a6ddf1-91d1-427b-8d08-4bb7ec668f74 service nova] Releasing lock "refresh_cache-6db680e7-3e21-4451-a0b1-29f9eca59b2f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Acquiring lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:54 user nova-compute[75285]: DEBUG nova.compute.manager [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:04:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:54 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:04:54 user nova-compute[75285]: INFO nova.compute.claims [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Claim successful on node user
Nov 10 21:04:55 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG nova.network.neutron [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:04:55 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:04:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG nova.policy [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '405bfc6bb94f44edb16c530658ea8b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a036a3b23594844903849039ec324ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:04:55 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Creating image(s)
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "/opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "/opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk 1073741824" returned: 0 in 0.051s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG nova.network.neutron [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Successfully created port: b74c53ea-d0fa-4971-9997-31413b2df6e5 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.206s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:04:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Cannot resize image /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Ensure instance console log exists: /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7ad2d544-8c98-47d1-9a3c-7f64d3f8b6a8 req-3e4903a5-7144-482c-a725-a368f54a9174 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Received event network-changed-9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7ad2d544-8c98-47d1-9a3c-7f64d3f8b6a8 req-3e4903a5-7144-482c-a725-a368f54a9174 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Refreshing instance network info cache due to event network-changed-9179b028-23d4-4b6e-bac0-9df516cc9dfe. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7ad2d544-8c98-47d1-9a3c-7f64d3f8b6a8 req-3e4903a5-7144-482c-a725-a368f54a9174 service nova] Acquiring lock "refresh_cache-ec5dca1b-b623-4a12-af56-aa2bce208869" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7ad2d544-8c98-47d1-9a3c-7f64d3f8b6a8 req-3e4903a5-7144-482c-a725-a368f54a9174 service nova] Acquired lock "refresh_cache-ec5dca1b-b623-4a12-af56-aa2bce208869" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG nova.network.neutron [req-7ad2d544-8c98-47d1-9a3c-7f64d3f8b6a8 req-3e4903a5-7144-482c-a725-a368f54a9174 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Refreshing network info cache for port 9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Successfully updated port: b74c53ea-d0fa-4971-9997-31413b2df6e5 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Acquiring lock "refresh_cache-4ace88c2-e7f4-4ed8-8ac8-1759f160db04" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Acquired lock "refresh_cache-4ace88c2-e7f4-4ed8-8ac8-1759f160db04" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-aabfb9db-dbb0-4ae8-8246-94182b89dfaa req-ded32576-a9a6-41b8-a91d-f2a22189dddd service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Received event network-changed-b74c53ea-d0fa-4971-9997-31413b2df6e5 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-aabfb9db-dbb0-4ae8-8246-94182b89dfaa req-ded32576-a9a6-41b8-a91d-f2a22189dddd service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Refreshing instance network info cache due to event network-changed-b74c53ea-d0fa-4971-9997-31413b2df6e5. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-aabfb9db-dbb0-4ae8-8246-94182b89dfaa req-ded32576-a9a6-41b8-a91d-f2a22189dddd service nova] Acquiring lock "refresh_cache-4ace88c2-e7f4-4ed8-8ac8-1759f160db04" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:04:56 user nova-compute[75285]: DEBUG nova.network.neutron [req-7ad2d544-8c98-47d1-9a3c-7f64d3f8b6a8 req-3e4903a5-7144-482c-a725-a368f54a9174 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Updated VIF entry in instance network info cache for port 9179b028-23d4-4b6e-bac0-9df516cc9dfe. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.network.neutron [req-7ad2d544-8c98-47d1-9a3c-7f64d3f8b6a8 req-3e4903a5-7144-482c-a725-a368f54a9174 service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Updating instance_info_cache with network_info: [{"id": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "address": "fa:16:3e:79:58:f8", "network": {"id": "35b31ce0-80bb-48f2-a9dd-1c30acbca7e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1234893326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ceffccaaef04b4ebb2fc39daf3a66ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9179b028-23", "ovs_interfaceid": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7ad2d544-8c98-47d1-9a3c-7f64d3f8b6a8 req-3e4903a5-7144-482c-a725-a368f54a9174 service nova] Releasing lock "refresh_cache-ec5dca1b-b623-4a12-af56-aa2bce208869" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.network.neutron [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Updating instance_info_cache with network_info: [{"id": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "address": "fa:16:3e:f5:83:24", "network": {"id": "90b53dce-16d8-45a8-a427-f54e01b2bb1d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180545890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a036a3b23594844903849039ec324ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c53ea-d0", "ovs_interfaceid": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Releasing lock "refresh_cache-4ace88c2-e7f4-4ed8-8ac8-1759f160db04" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Instance network_info: |[{"id": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "address": "fa:16:3e:f5:83:24", "network": {"id": "90b53dce-16d8-45a8-a427-f54e01b2bb1d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180545890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a036a3b23594844903849039ec324ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c53ea-d0", "ovs_interfaceid": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-aabfb9db-dbb0-4ae8-8246-94182b89dfaa req-ded32576-a9a6-41b8-a91d-f2a22189dddd service nova] Acquired lock "refresh_cache-4ace88c2-e7f4-4ed8-8ac8-1759f160db04" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.network.neutron [req-aabfb9db-dbb0-4ae8-8246-94182b89dfaa req-ded32576-a9a6-41b8-a91d-f2a22189dddd service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Refreshing network info cache for port b74c53ea-d0fa-4971-9997-31413b2df6e5 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Start _get_guest_xml network_info=[{"id": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "address": "fa:16:3e:f5:83:24", "network": {"id": "90b53dce-16d8-45a8-a427-f54e01b2bb1d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180545890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a036a3b23594844903849039ec324ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c53ea-d0", "ovs_interfaceid": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:04:57 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:04:57 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1576916665',display_name='tempest-VolumesActionsTest-instance-1576916665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1576916665',id=10,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a036a3b23594844903849039ec324ed',ramdisk_id='',reservation_id='r-k3kio371',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1573453425',owner_user_name='tempest-VolumesActionsTest-1573453425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:55Z,user_data=None,user_id='405bfc6bb94f44edb16c530658ea8b36',uuid=4ace88c2-e7f4-4ed8-8ac8-1759f160db04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "address": "fa:16:3e:f5:83:24", "network": {"id": "90b53dce-16d8-45a8-a427-f54e01b2bb1d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180545890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a036a3b23594844903849039ec324ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c53ea-d0", "ovs_interfaceid": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Converting VIF {"id": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "address": "fa:16:3e:f5:83:24", "network": {"id": "90b53dce-16d8-45a8-a427-f54e01b2bb1d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180545890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a036a3b23594844903849039ec324ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c53ea-d0", "ovs_interfaceid": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:24,bridge_name='br-int',has_traffic_filtering=True,id=b74c53ea-d0fa-4971-9997-31413b2df6e5,network=Network(90b53dce-16d8-45a8-a427-f54e01b2bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb74c53ea-d0') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.objects.instance [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ace88c2-e7f4-4ed8-8ac8-1759f160db04 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:04:57 user nova-compute[75285]:   <uuid>4ace88c2-e7f4-4ed8-8ac8-1759f160db04</uuid>
Nov 10 21:04:57 user nova-compute[75285]:   <name>instance-0000000a</name>
Nov 10 21:04:57 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:04:57 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:04:57 user nova-compute[75285]:   <metadata>
Nov 10 21:04:57 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:04:57 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:04:57 user nova-compute[75285]:       <nova:name>tempest-VolumesActionsTest-instance-1576916665</nova:name>
Nov 10 21:04:57 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:04:57</nova:creationTime>
Nov 10 21:04:57 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:04:57 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:04:57 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:04:57 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:04:57 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:04:57 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:04:57 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:04:57 user nova-compute[75285]:       <nova:owner>
Nov 10 21:04:57 user nova-compute[75285]:         <nova:user uuid="405bfc6bb94f44edb16c530658ea8b36">tempest-VolumesActionsTest-1573453425-project-member</nova:user>
Nov 10 21:04:57 user nova-compute[75285]:         <nova:project uuid="4a036a3b23594844903849039ec324ed">tempest-VolumesActionsTest-1573453425</nova:project>
Nov 10 21:04:57 user nova-compute[75285]:       </nova:owner>
Nov 10 21:04:57 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:04:57 user nova-compute[75285]:       <nova:ports>
Nov 10 21:04:57 user nova-compute[75285]:         <nova:port uuid="b74c53ea-d0fa-4971-9997-31413b2df6e5">
Nov 10 21:04:57 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 21:04:57 user nova-compute[75285]:         </nova:port>
Nov 10 21:04:57 user nova-compute[75285]:       </nova:ports>
Nov 10 21:04:57 user nova-compute[75285]:     </nova:instance>
Nov 10 21:04:57 user nova-compute[75285]:   </metadata>
Nov 10 21:04:57 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:04:57 user nova-compute[75285]:     <system>
Nov 10 21:04:57 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:04:57 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:04:57 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:04:57 user nova-compute[75285]:       <entry name="serial">4ace88c2-e7f4-4ed8-8ac8-1759f160db04</entry>
Nov 10 21:04:57 user nova-compute[75285]:       <entry name="uuid">4ace88c2-e7f4-4ed8-8ac8-1759f160db04</entry>
Nov 10 21:04:57 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:04:57 user nova-compute[75285]:     </system>
Nov 10 21:04:57 user nova-compute[75285]:   </sysinfo>
Nov 10 21:04:57 user nova-compute[75285]:   <os>
Nov 10 21:04:57 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:04:57 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:04:57 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:04:57 user nova-compute[75285]:   </os>
Nov 10 21:04:57 user nova-compute[75285]:   <features>
Nov 10 21:04:57 user nova-compute[75285]:     <acpi/>
Nov 10 21:04:57 user nova-compute[75285]:     <apic/>
Nov 10 21:04:57 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:04:57 user nova-compute[75285]:   </features>
Nov 10 21:04:57 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:04:57 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:04:57 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:04:57 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:04:57 user nova-compute[75285]:   </clock>
Nov 10 21:04:57 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:04:57 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:04:57 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:04:57 user nova-compute[75285]:   </cpu>
Nov 10 21:04:57 user nova-compute[75285]:   <devices>
Nov 10 21:04:57 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:04:57 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:04:57 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk"/>
Nov 10 21:04:57 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:04:57 user nova-compute[75285]:     </disk>
Nov 10 21:04:57 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:04:57 user nova-compute[75285]:       <mac address="fa:16:3e:f5:83:24"/>
Nov 10 21:04:57 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:04:57 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:04:57 user nova-compute[75285]:       <target dev="tapb74c53ea-d0"/>
Nov 10 21:04:57 user nova-compute[75285]:     </interface>
Nov 10 21:04:57 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:04:57 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/console.log" append="off"/>
Nov 10 21:04:57 user nova-compute[75285]:     </serial>
Nov 10 21:04:57 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:04:57 user nova-compute[75285]:     <video>
Nov 10 21:04:57 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:04:57 user nova-compute[75285]:     </video>
Nov 10 21:04:57 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:04:57 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:04:57 user nova-compute[75285]:     </rng>
Nov 10 21:04:57 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:04:57 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:04:57 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:04:57 user nova-compute[75285]:     </memballoon>
Nov 10 21:04:57 user nova-compute[75285]:   </devices>
Nov 10 21:04:57 user nova-compute[75285]: </domain>
Nov 10 21:04:57 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1576916665',display_name='tempest-VolumesActionsTest-instance-1576916665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1576916665',id=10,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a036a3b23594844903849039ec324ed',ramdisk_id='',reservation_id='r-k3kio371',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1573453425',owner_user_name='tempest-VolumesActionsTest-1573453425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:55Z,user_data=None,user_id='405bfc6bb94f44edb16c530658ea8b36',uuid=4ace88c2-e7f4-4ed8-8ac8-1759f160db04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "address": "fa:16:3e:f5:83:24", "network": {"id": "90b53dce-16d8-45a8-a427-f54e01b2bb1d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180545890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a036a3b23594844903849039ec324ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c53ea-d0", "ovs_interfaceid": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Converting VIF {"id": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "address": "fa:16:3e:f5:83:24", "network": {"id": "90b53dce-16d8-45a8-a427-f54e01b2bb1d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180545890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a036a3b23594844903849039ec324ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c53ea-d0", "ovs_interfaceid": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:24,bridge_name='br-int',has_traffic_filtering=True,id=b74c53ea-d0fa-4971-9997-31413b2df6e5,network=Network(90b53dce-16d8-45a8-a427-f54e01b2bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb74c53ea-d0') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG os_vif [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:24,bridge_name='br-int',has_traffic_filtering=True,id=b74c53ea-d0fa-4971-9997-31413b2df6e5,network=Network(90b53dce-16d8-45a8-a427-f54e01b2bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb74c53ea-d0') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '307e3ade-2a1b-52d1-8e16-2f54d7457986', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb74c53ea-d0, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb74c53ea-d0, col_values=(('qos', UUID('14a65280-ac5e-4e0e-a4eb-4e9b04f4713b')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb74c53ea-d0, col_values=(('external_ids', {'iface-id': 'b74c53ea-d0fa-4971-9997-31413b2df6e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:83:24', 'vm-uuid': '4ace88c2-e7f4-4ed8-8ac8-1759f160db04'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:57 user nova-compute[75285]: INFO os_vif [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:24,bridge_name='br-int',has_traffic_filtering=True,id=b74c53ea-d0fa-4971-9997-31413b2df6e5,network=Network(90b53dce-16d8-45a8-a427-f54e01b2bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb74c53ea-d0')
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] No VIF found with MAC fa:16:3e:f5:83:24, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.network.neutron [req-aabfb9db-dbb0-4ae8-8246-94182b89dfaa req-ded32576-a9a6-41b8-a91d-f2a22189dddd service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Updated VIF entry in instance network info cache for port b74c53ea-d0fa-4971-9997-31413b2df6e5. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG nova.network.neutron [req-aabfb9db-dbb0-4ae8-8246-94182b89dfaa req-ded32576-a9a6-41b8-a91d-f2a22189dddd service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Updating instance_info_cache with network_info: [{"id": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "address": "fa:16:3e:f5:83:24", "network": {"id": "90b53dce-16d8-45a8-a427-f54e01b2bb1d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180545890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a036a3b23594844903849039ec324ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c53ea-d0", "ovs_interfaceid": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:04:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-aabfb9db-dbb0-4ae8-8246-94182b89dfaa req-ded32576-a9a6-41b8-a91d-f2a22189dddd service nova] Releasing lock "refresh_cache-4ace88c2-e7f4-4ed8-8ac8-1759f160db04" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:04:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-3a1716f8-211e-497b-ba23-2a5590e1cdd0 req-59622f03-374e-4b62-916f-bc90d60c46ee service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Received event network-vif-plugged-b74c53ea-d0fa-4971-9997-31413b2df6e5 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:04:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3a1716f8-211e-497b-ba23-2a5590e1cdd0 req-59622f03-374e-4b62-916f-bc90d60c46ee service nova] Acquiring lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:04:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3a1716f8-211e-497b-ba23-2a5590e1cdd0 req-59622f03-374e-4b62-916f-bc90d60c46ee service nova] Lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:04:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3a1716f8-211e-497b-ba23-2a5590e1cdd0 req-59622f03-374e-4b62-916f-bc90d60c46ee service nova] Lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:04:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-3a1716f8-211e-497b-ba23-2a5590e1cdd0 req-59622f03-374e-4b62-916f-bc90d60c46ee service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] No waiting events found dispatching network-vif-plugged-b74c53ea-d0fa-4971-9997-31413b2df6e5 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:04:58 user nova-compute[75285]: WARNING nova.compute.manager [req-3a1716f8-211e-497b-ba23-2a5590e1cdd0 req-59622f03-374e-4b62-916f-bc90d60c46ee service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Received unexpected event network-vif-plugged-b74c53ea-d0fa-4971-9997-31413b2df6e5 for instance with vm_state building and task_state spawning.
Nov 10 21:04:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:04:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:05:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:05:00 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Instance spawned successfully.
Nov 10 21:05:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:05:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-4d187216-d2e9-4904-900e-9ac9db467539 req-6e0b1f20-fe09-4860-856e-d7768d484b7b service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Received event network-vif-plugged-b74c53ea-d0fa-4971-9997-31413b2df6e5 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:05:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4d187216-d2e9-4904-900e-9ac9db467539 req-6e0b1f20-fe09-4860-856e-d7768d484b7b service nova] Acquiring lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4d187216-d2e9-4904-900e-9ac9db467539 req-6e0b1f20-fe09-4860-856e-d7768d484b7b service nova] Lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4d187216-d2e9-4904-900e-9ac9db467539 req-6e0b1f20-fe09-4860-856e-d7768d484b7b service nova] Lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:05:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-4d187216-d2e9-4904-900e-9ac9db467539 req-6e0b1f20-fe09-4860-856e-d7768d484b7b service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] No waiting events found dispatching network-vif-plugged-b74c53ea-d0fa-4971-9997-31413b2df6e5 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:05:00 user nova-compute[75285]: WARNING nova.compute.manager [req-4d187216-d2e9-4904-900e-9ac9db467539 req-6e0b1f20-fe09-4860-856e-d7768d484b7b service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Received unexpected event network-vif-plugged-b74c53ea-d0fa-4971-9997-31413b2df6e5 for instance with vm_state building and task_state spawning.
Nov 10 21:05:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:05:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:05:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:05:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:05:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:05:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:05:01 user nova-compute[75285]: INFO nova.compute.manager [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 10 21:05:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:05:01 user nova-compute[75285]: INFO nova.compute.manager [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Took 6.55 seconds to build instance.
Nov 10 21:05:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-602fa040-f86c-48ce-9b75-7c59674c56c3 tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.672s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:05:02 user nova-compute[75285]: INFO nova.virt.block_device [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Booting with volume 9d7ed375-8c35-4522-8f63-bcdf78c5ca8d at /dev/vdb
Nov 10 21:05:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG os_brick.utils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a521cb-7ffc-4be6-9a07-30ddc7af4f6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[203348f8-4c2f-436a-b084-c80a67f4f0af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d8c1b9-3a1e-40cf-8fbd-e9e2e9ace768]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafafb67-7e81-4dce-9659-ad50a421a631]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:05:02 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:05:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca557c8-660b-4c7c-978f-1415382d70e0]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG os_brick.utils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:05:02 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updating existing volume attachment record: 3f8b8551-3b52-43bc-a2a9-2dcd7eedf5be {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:05:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "ec5dca1b-b623-4a12-af56-aa2bce208869" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:03 user nova-compute[75285]: DEBUG nova.objects.instance [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lazy-loading 'flavor' on Instance uuid ec5dca1b-b623-4a12-af56-aa2bce208869 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:05:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:05:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-3ad18fa8-e204-4a76-b596-f0e05ee5c4f2 req-597814f0-1cac-449d-a343-0e21ae82087d service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received event network-changed-46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:05:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-3ad18fa8-e204-4a76-b596-f0e05ee5c4f2 req-597814f0-1cac-449d-a343-0e21ae82087d service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Refreshing instance network info cache due to event network-changed-46353ed3-1736-493a-99b8-580504a9abc9. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:05:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3ad18fa8-e204-4a76-b596-f0e05ee5c4f2 req-597814f0-1cac-449d-a343-0e21ae82087d service nova] Acquiring lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:05:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3ad18fa8-e204-4a76-b596-f0e05ee5c4f2 req-597814f0-1cac-449d-a343-0e21ae82087d service nova] Acquired lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:05:03 user nova-compute[75285]: DEBUG nova.network.neutron [req-3ad18fa8-e204-4a76-b596-f0e05ee5c4f2 req-597814f0-1cac-449d-a343-0e21ae82087d service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Refreshing network info cache for port 46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:05:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "ec5dca1b-b623-4a12-af56-aa2bce208869" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:03 user nova-compute[75285]: INFO nova.compute.manager [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Attaching volume 64aa237c-d313-4e40-85c0-a3c74ad70343 to /dev/sdc
Nov 10 21:05:04 user nova-compute[75285]: DEBUG os_brick.utils [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[521fadb4-28bd-494b-b6e2-bdd16815deb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d144bf16-71de-49d3-adbe-f8e15c329b68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e290f9-22ff-45e1-bcdd-fed3a14ca544]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dd138e-965f-4cd4-8d0b-3dedf35de06a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:05:04 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ae8913-9c88-485f-b690-3850f22850f2]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG os_brick.utils [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Updating existing volume attachment record: f0350f85-7445-48d7-9978-bca7ff071cba {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG nova.objects.instance [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lazy-loading 'flavor' on Instance uuid 6db680e7-3e21-4451-a0b1-29f9eca59b2f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "interface-431a5e3b-068c-4da3-8198-85b4dcafd266-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "interface-431a5e3b-068c-4da3-8198-85b4dcafd266-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG nova.objects.instance [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lazy-loading 'flavor' on Instance uuid 431a5e3b-068c-4da3-8198-85b4dcafd266 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG nova.network.neutron [req-3ad18fa8-e204-4a76-b596-f0e05ee5c4f2 req-597814f0-1cac-449d-a343-0e21ae82087d service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Updated VIF entry in instance network info cache for port 46353ed3-1736-493a-99b8-580504a9abc9. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG nova.network.neutron [req-3ad18fa8-e204-4a76-b596-f0e05ee5c4f2 req-597814f0-1cac-449d-a343-0e21ae82087d service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Updating instance_info_cache with network_info: [{"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3ad18fa8-e204-4a76-b596-f0e05ee5c4f2 req-597814f0-1cac-449d-a343-0e21ae82087d service nova] Releasing lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:04 user nova-compute[75285]: INFO nova.compute.manager [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Attaching volume f6242c82-7d92-4452-a904-81ab911a0720 to /dev/vdb
Nov 10 21:05:04 user nova-compute[75285]: DEBUG os_brick.utils [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5217253-ab1c-43f0-96e5-c7dbcc71ffbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG nova.objects.instance [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lazy-loading 'pci_requests' on Instance uuid 431a5e3b-068c-4da3-8198-85b4dcafd266 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e725aefc-0923-4146-8c9b-73d088460151]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG nova.objects.base [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Object Instance<431a5e3b-068c-4da3-8198-85b4dcafd266> lazy-loaded attributes: flavor,pci_requests {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG nova.network.neutron [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[82884e46-78ac-484b-8406-12bf07271b1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4810f278-4b41-42d7-af20-a89930ab87a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:05:04 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:05:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac456e61-1897-4e94-80fb-652682e127f8]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG os_brick.utils [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Updating existing volume attachment record: aadcdbf5-8ef7-4f5c-afc8-430aceba5618 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:05:04 user nova-compute[75285]: DEBUG nova.policy [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f018af822634a0b8b9902c811637795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc434b2e3e46c3998436f1c6ae971a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:05:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:05 user nova-compute[75285]: DEBUG nova.network.neutron [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Successfully created port: 8f2bb0e5-40d2-4044-b859-039ea6160907 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:05:06 user nova-compute[75285]: DEBUG nova.network.neutron [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Successfully updated port: 8f2bb0e5-40d2-4044-b859-039ea6160907 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:05:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:05:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquired lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:05:06 user nova-compute[75285]: DEBUG nova.network.neutron [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:05:06 user nova-compute[75285]: DEBUG nova.compute.manager [req-db13e1d9-bcc7-45a4-addc-9c95f974fa03 req-50b6413b-6cf7-4365-b655-e7097036626c service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received event network-changed-8f2bb0e5-40d2-4044-b859-039ea6160907 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:05:06 user nova-compute[75285]: DEBUG nova.compute.manager [req-db13e1d9-bcc7-45a4-addc-9c95f974fa03 req-50b6413b-6cf7-4365-b655-e7097036626c service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Refreshing instance network info cache due to event network-changed-8f2bb0e5-40d2-4044-b859-039ea6160907. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:05:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-db13e1d9-bcc7-45a4-addc-9c95f974fa03 req-50b6413b-6cf7-4365-b655-e7097036626c service nova] Acquiring lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-5e32425f-fec9-4c41-a161-3e6f8dd843ff req-22d91f88-41b3-438b-9bc6-b99b5e7e1e5b service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received event network-changed-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-5e32425f-fec9-4c41-a161-3e6f8dd843ff req-22d91f88-41b3-438b-9bc6-b99b5e7e1e5b service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Refreshing instance network info cache due to event network-changed-996db12a-8c23-4a7e-91f4-e0f87358b2a6. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e32425f-fec9-4c41-a161-3e6f8dd843ff req-22d91f88-41b3-438b-9bc6-b99b5e7e1e5b service nova] Acquiring lock "refresh_cache-8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e32425f-fec9-4c41-a161-3e6f8dd843ff req-22d91f88-41b3-438b-9bc6-b99b5e7e1e5b service nova] Acquired lock "refresh_cache-8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG nova.network.neutron [req-5e32425f-fec9-4c41-a161-3e6f8dd843ff req-22d91f88-41b3-438b-9bc6-b99b5e7e1e5b service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Refreshing network info cache for port 996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG nova.network.neutron [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Updating instance_info_cache with network_info: [{"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8f2bb0e5-40d2-4044-b859-039ea6160907", "address": "fa:16:3e:c2:90:32", "network": {"id": "44f55482-2ba6-4d93-ad7b-18394f52c1e2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1576076603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2bb0e5-40", "ovs_interfaceid": "8f2bb0e5-40d2-4044-b859-039ea6160907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Releasing lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-db13e1d9-bcc7-45a4-addc-9c95f974fa03 req-50b6413b-6cf7-4365-b655-e7097036626c service nova] Acquired lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG nova.network.neutron [req-db13e1d9-bcc7-45a4-addc-9c95f974fa03 req-50b6413b-6cf7-4365-b655-e7097036626c service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Refreshing network info cache for port 8f2bb0e5-40d2-4044-b859-039ea6160907 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1188264763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1188264763',id=6,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJVDaV9K6SBR1XEp4BdAS6FdSHtLIn40w3r0dF5WwWJ6G68NbKximpSS6o3RxdgTS65FI2WOslaptWqshVaLeSVBsAD2z4r2afuysf1qmQl+94ffn2lCbbP+vU1cmDehA==',key_name='tempest-keypair-1028305531',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:03:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='96cc434b2e3e46c3998436f1c6ae971a',ramdisk_id='',reservation_id='r-dswcb0qh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-941419187',owner_user_name='tempest-TaggedAttachmentsTest-941419187-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f018af822634a0b8b9902c811637795',uuid=431a5e3b-068c-4da3-8198-85b4dcafd266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f2bb0e5-40d2-4044-b859-039ea6160907", "address": "fa:16:3e:c2:90:32", "network": {"id": "44f55482-2ba6-4d93-ad7b-18394f52c1e2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1576076603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2bb0e5-40", "ovs_interfaceid": "8f2bb0e5-40d2-4044-b859-039ea6160907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Converting VIF {"id": "8f2bb0e5-40d2-4044-b859-039ea6160907", "address": "fa:16:3e:c2:90:32", "network": {"id": "44f55482-2ba6-4d93-ad7b-18394f52c1e2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1576076603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2bb0e5-40", "ovs_interfaceid": "8f2bb0e5-40d2-4044-b859-039ea6160907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:90:32,bridge_name='br-int',has_traffic_filtering=True,id=8f2bb0e5-40d2-4044-b859-039ea6160907,network=Network(44f55482-2ba6-4d93-ad7b-18394f52c1e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2bb0e5-40') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG os_vif [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:90:32,bridge_name='br-int',has_traffic_filtering=True,id=8f2bb0e5-40d2-4044-b859-039ea6160907,network=Network(44f55482-2ba6-4d93-ad7b-18394f52c1e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2bb0e5-40') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '258daa9a-a994-5ce7-abbb-d00502df3d4d', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f2bb0e5-40, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f2bb0e5-40, col_values=(('qos', UUID('fb29a075-d519-4575-b676-d63b575d867b')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f2bb0e5-40, col_values=(('external_ids', {'iface-id': '8f2bb0e5-40d2-4044-b859-039ea6160907', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:90:32', 'vm-uuid': '431a5e3b-068c-4da3-8198-85b4dcafd266'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:07 user nova-compute[75285]: INFO os_vif [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:90:32,bridge_name='br-int',has_traffic_filtering=True,id=8f2bb0e5-40d2-4044-b859-039ea6160907,network=Network(44f55482-2ba6-4d93-ad7b-18394f52c1e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2bb0e5-40')
Nov 10 21:05:07 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1188264763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1188264763',id=6,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJVDaV9K6SBR1XEp4BdAS6FdSHtLIn40w3r0dF5WwWJ6G68NbKximpSS6o3RxdgTS65FI2WOslaptWqshVaLeSVBsAD2z4r2afuysf1qmQl+94ffn2lCbbP+vU1cmDehA==',key_name='tempest-keypair-1028305531',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:03:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='96cc434b2e3e46c3998436f1c6ae971a',ramdisk_id='',reservation_id='r-dswcb0qh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-941419187',owner_user_name='tempest-TaggedAttachmentsTest-941419187-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f018af822634a0b8b9902c811637795',uuid=431a5e3b-068c-4da3-8198-85b4dcafd266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f2bb0e5-40d2-4044-b859-039ea6160907", "address": "fa:16:3e:c2:90:32", "network": {"id": "44f55482-2ba6-4d93-ad7b-18394f52c1e2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1576076603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2bb0e5-40", "ovs_interfaceid": "8f2bb0e5-40d2-4044-b859-039ea6160907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Converting VIF {"id": "8f2bb0e5-40d2-4044-b859-039ea6160907", "address": "fa:16:3e:c2:90:32", "network": {"id": "44f55482-2ba6-4d93-ad7b-18394f52c1e2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1576076603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2bb0e5-40", "ovs_interfaceid": "8f2bb0e5-40d2-4044-b859-039ea6160907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:90:32,bridge_name='br-int',has_traffic_filtering=True,id=8f2bb0e5-40d2-4044-b859-039ea6160907,network=Network(44f55482-2ba6-4d93-ad7b-18394f52c1e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2bb0e5-40') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] attach device xml: <interface type="ethernet">
Nov 10 21:05:07 user nova-compute[75285]:   <mac address="fa:16:3e:c2:90:32"/>
Nov 10 21:05:07 user nova-compute[75285]:   <model type="virtio"/>
Nov 10 21:05:07 user nova-compute[75285]:   <mtu size="1442"/>
Nov 10 21:05:07 user nova-compute[75285]:   <target dev="tap8f2bb0e5-40"/>
Nov 10 21:05:07 user nova-compute[75285]: </interface>
Nov 10 21:05:07 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG nova.network.neutron [req-5e32425f-fec9-4c41-a161-3e6f8dd843ff req-22d91f88-41b3-438b-9bc6-b99b5e7e1e5b service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Updated VIF entry in instance network info cache for port 996db12a-8c23-4a7e-91f4-e0f87358b2a6. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG nova.network.neutron [req-5e32425f-fec9-4c41-a161-3e6f8dd843ff req-22d91f88-41b3-438b-9bc6-b99b5e7e1e5b service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Updating instance_info_cache with network_info: [{"id": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "address": "fa:16:3e:1f:23:b7", "network": {"id": "10f7fc99-7b04-4985-b19e-fb751f9b528c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1893985114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb80a67cb94284b19514d996fd0bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996db12a-8c", "ovs_interfaceid": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:05:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e32425f-fec9-4c41-a161-3e6f8dd843ff req-22d91f88-41b3-438b-9bc6-b99b5e7e1e5b service nova] Releasing lock "refresh_cache-8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:05:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:05:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] No BDM found with device name hda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:05:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] No VIF found with MAC fa:16:3e:06:22:3a, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:05:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:05:08 user nova-compute[75285]:   <nova:package version="0.0.0"/>
Nov 10 21:05:08 user nova-compute[75285]:   <nova:name>tempest-device-tagging-server-1188264763</nova:name>
Nov 10 21:05:08 user nova-compute[75285]:   <nova:creationTime>2023-11-10 21:05:08</nova:creationTime>
Nov 10 21:05:08 user nova-compute[75285]:   <nova:flavor name="m1.tiny">
Nov 10 21:05:08 user nova-compute[75285]:     <nova:memory>512</nova:memory>
Nov 10 21:05:08 user nova-compute[75285]:     <nova:disk>1</nova:disk>
Nov 10 21:05:08 user nova-compute[75285]:     <nova:swap>0</nova:swap>
Nov 10 21:05:08 user nova-compute[75285]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:05:08 user nova-compute[75285]:     <nova:vcpus>1</nova:vcpus>
Nov 10 21:05:08 user nova-compute[75285]:   </nova:flavor>
Nov 10 21:05:08 user nova-compute[75285]:   <nova:owner>
Nov 10 21:05:08 user nova-compute[75285]:     <nova:user uuid="0f018af822634a0b8b9902c811637795">tempest-TaggedAttachmentsTest-941419187-project-member</nova:user>
Nov 10 21:05:08 user nova-compute[75285]:     <nova:project uuid="96cc434b2e3e46c3998436f1c6ae971a">tempest-TaggedAttachmentsTest-941419187</nova:project>
Nov 10 21:05:08 user nova-compute[75285]:   </nova:owner>
Nov 10 21:05:08 user nova-compute[75285]:   <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:05:08 user nova-compute[75285]:   <nova:ports>
Nov 10 21:05:08 user nova-compute[75285]:     <nova:port uuid="46353ed3-1736-493a-99b8-580504a9abc9">
Nov 10 21:05:08 user nova-compute[75285]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 21:05:08 user nova-compute[75285]:     </nova:port>
Nov 10 21:05:08 user nova-compute[75285]:     <nova:port uuid="8f2bb0e5-40d2-4044-b859-039ea6160907">
Nov 10 21:05:08 user nova-compute[75285]:       <nova:ip type="fixed" address="10.10.10.69" ipVersion="4"/>
Nov 10 21:05:08 user nova-compute[75285]:     </nova:port>
Nov 10 21:05:08 user nova-compute[75285]:   </nova:ports>
Nov 10 21:05:08 user nova-compute[75285]: </nova:instance>
Nov 10 21:05:08 user nova-compute[75285]:  {{(pid=75285) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 21:05:08 user nova-compute[75285]: DEBUG nova.network.neutron [req-db13e1d9-bcc7-45a4-addc-9c95f974fa03 req-50b6413b-6cf7-4365-b655-e7097036626c service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Updated VIF entry in instance network info cache for port 8f2bb0e5-40d2-4044-b859-039ea6160907. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:05:08 user nova-compute[75285]: DEBUG nova.network.neutron [req-db13e1d9-bcc7-45a4-addc-9c95f974fa03 req-50b6413b-6cf7-4365-b655-e7097036626c service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Updating instance_info_cache with network_info: [{"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8f2bb0e5-40d2-4044-b859-039ea6160907", "address": "fa:16:3e:c2:90:32", "network": {"id": "44f55482-2ba6-4d93-ad7b-18394f52c1e2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1576076603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2bb0e5-40", "ovs_interfaceid": "8f2bb0e5-40d2-4044-b859-039ea6160907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:05:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b1305031-48e8-4f3d-bdeb-24cae4d96507 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "interface-431a5e3b-068c-4da3-8198-85b4dcafd266-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.910s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:05:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-db13e1d9-bcc7-45a4-addc-9c95f974fa03 req-50b6413b-6cf7-4365-b655-e7097036626c service nova] Releasing lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:05:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-8acccc31-956d-4a1d-a142-b022123dab31 req-d7d6ac07-0941-4aa0-ab54-034b1cea4ef6 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received event network-vif-plugged-8f2bb0e5-40d2-4044-b859-039ea6160907 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:05:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8acccc31-956d-4a1d-a142-b022123dab31 req-d7d6ac07-0941-4aa0-ab54-034b1cea4ef6 service nova] Acquiring lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8acccc31-956d-4a1d-a142-b022123dab31 req-d7d6ac07-0941-4aa0-ab54-034b1cea4ef6 service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8acccc31-956d-4a1d-a142-b022123dab31 req-d7d6ac07-0941-4aa0-ab54-034b1cea4ef6 service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:05:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-8acccc31-956d-4a1d-a142-b022123dab31 req-d7d6ac07-0941-4aa0-ab54-034b1cea4ef6 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] No waiting events found dispatching network-vif-plugged-8f2bb0e5-40d2-4044-b859-039ea6160907 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:05:09 user nova-compute[75285]: WARNING nova.compute.manager [req-8acccc31-956d-4a1d-a142-b022123dab31 req-d7d6ac07-0941-4aa0-ab54-034b1cea4ef6 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received unexpected event network-vif-plugged-8f2bb0e5-40d2-4044-b859-039ea6160907 for instance with vm_state active and task_state None.
Nov 10 21:05:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-8acccc31-956d-4a1d-a142-b022123dab31 req-d7d6ac07-0941-4aa0-ab54-034b1cea4ef6 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received event network-vif-plugged-8f2bb0e5-40d2-4044-b859-039ea6160907 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:05:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8acccc31-956d-4a1d-a142-b022123dab31 req-d7d6ac07-0941-4aa0-ab54-034b1cea4ef6 service nova] Acquiring lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8acccc31-956d-4a1d-a142-b022123dab31 req-d7d6ac07-0941-4aa0-ab54-034b1cea4ef6 service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8acccc31-956d-4a1d-a142-b022123dab31 req-d7d6ac07-0941-4aa0-ab54-034b1cea4ef6 service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:05:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-8acccc31-956d-4a1d-a142-b022123dab31 req-d7d6ac07-0941-4aa0-ab54-034b1cea4ef6 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] No waiting events found dispatching network-vif-plugged-8f2bb0e5-40d2-4044-b859-039ea6160907 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:05:09 user nova-compute[75285]: WARNING nova.compute.manager [req-8acccc31-956d-4a1d-a142-b022123dab31 req-d7d6ac07-0941-4aa0-ab54-034b1cea4ef6 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received unexpected event network-vif-plugged-8f2bb0e5-40d2-4044-b859-039ea6160907 for instance with vm_state active and task_state None.
Nov 10 21:05:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:11 user nova-compute[75285]: DEBUG nova.compute.manager [req-84b15f35-c43b-4f4f-bc9d-1ce7e0d19953 req-ecac7f72-c3d4-4029-a2bc-b3afb77e78d7 service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Received event network-changed-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:05:11 user nova-compute[75285]: DEBUG nova.compute.manager [req-84b15f35-c43b-4f4f-bc9d-1ce7e0d19953 req-ecac7f72-c3d4-4029-a2bc-b3afb77e78d7 service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Refreshing instance network info cache due to event network-changed-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:05:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-84b15f35-c43b-4f4f-bc9d-1ce7e0d19953 req-ecac7f72-c3d4-4029-a2bc-b3afb77e78d7 service nova] Acquiring lock "refresh_cache-82a83f12-0822-4cd0-8d1b-3f939a601745" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:05:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-84b15f35-c43b-4f4f-bc9d-1ce7e0d19953 req-ecac7f72-c3d4-4029-a2bc-b3afb77e78d7 service nova] Acquired lock "refresh_cache-82a83f12-0822-4cd0-8d1b-3f939a601745" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:05:11 user nova-compute[75285]: DEBUG nova.network.neutron [req-84b15f35-c43b-4f4f-bc9d-1ce7e0d19953 req-ecac7f72-c3d4-4029-a2bc-b3afb77e78d7 service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Refreshing network info cache for port 5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:05:12 user nova-compute[75285]: DEBUG nova.network.neutron [req-84b15f35-c43b-4f4f-bc9d-1ce7e0d19953 req-ecac7f72-c3d4-4029-a2bc-b3afb77e78d7 service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Updated VIF entry in instance network info cache for port 5f6ffcbc-caa3-42c2-b73a-06ee4a95946b. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:05:12 user nova-compute[75285]: DEBUG nova.network.neutron [req-84b15f35-c43b-4f4f-bc9d-1ce7e0d19953 req-ecac7f72-c3d4-4029-a2bc-b3afb77e78d7 service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Updating instance_info_cache with network_info: [{"id": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "address": "fa:16:3e:44:22:16", "network": {"id": "a71f1ce1-f597-4e04-8039-515b9c112b34", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1988900701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e29618f896244f999368b8e855e865b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ffcbc-ca", "ovs_interfaceid": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:05:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-84b15f35-c43b-4f4f-bc9d-1ce7e0d19953 req-ecac7f72-c3d4-4029-a2bc-b3afb77e78d7 service nova] Releasing lock "refresh_cache-82a83f12-0822-4cd0-8d1b-3f939a601745" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:05:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:29 user nova-compute[75285]: DEBUG nova.objects.instance [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lazy-loading 'flavor' on Instance uuid 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:05:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "431a5e3b-068c-4da3-8198-85b4dcafd266" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:05:29 user nova-compute[75285]: DEBUG nova.objects.instance [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lazy-loading 'flavor' on Instance uuid 431a5e3b-068c-4da3-8198-85b4dcafd266 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:05:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Acquiring lock "82a83f12-0822-4cd0-8d1b-3f939a601745" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:05:29 user nova-compute[75285]: DEBUG nova.objects.instance [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lazy-loading 'flavor' on Instance uuid 82a83f12-0822-4cd0-8d1b-3f939a601745 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:05:29 user nova-compute[75285]: INFO nova.virt.block_device [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Booting with volume 63c74ae0-495c-4359-aef0-ebd1c41a5b85 at /dev/vdc
Nov 10 21:05:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:30 user nova-compute[75285]: INFO nova.compute.manager [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Attaching volume 7e4cfc71-aa34-4830-b7d4-c49ece3e3cec to /dev/vdb
Nov 10 21:05:30 user nova-compute[75285]: DEBUG os_brick.utils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39b253a-4130-47e9-a2af-7f0ebac7b29a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[517587ae-0946-408e-a220-cc3fb010470d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4fdb76-1daf-436e-aae1-0f7cf35935e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca479873-eaee-4c20-8c70-a5de0f501c7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:05:30 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[de410db5-96d3-4935-bff3-d4a468bdf399]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG os_brick.utils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updating existing volume attachment record: 4582e7eb-ea0a-4e04-bef3-865285c65952 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "431a5e3b-068c-4da3-8198-85b4dcafd266" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:30 user nova-compute[75285]: INFO nova.compute.manager [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Attaching volume e77d5094-24a5-4e04-9554-d82a6274d01b to /dev/vdb
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Acquiring lock "82a83f12-0822-4cd0-8d1b-3f939a601745" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:30 user nova-compute[75285]: INFO nova.compute.manager [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Attaching volume 2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 to /dev/vdb
Nov 10 21:05:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connector [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Factory for ISCSI on None {{(pid=75285) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBJvulUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:05:31 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:05:31 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:05:31 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1ad29d-c923-4088-b762-7d0436ffb639]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:05:31 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[48364bc4-b40e-4aae-9715-f06117e5ebf8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343] added
Nov 10 21:05:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a9c0f0-05f3-476c-bc04-1242a8953a7e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fc5fc8-ebd7-4080-8533-bb87740b18a6]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VBJvulUo {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VBJvulUo" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4a1d9d-cb54-49a2-86e4-003fb3677e8e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VBJvulUo'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.utils [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd4ba26-7e47-40bf-8e48-d614eed5dbed]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8742b47-219a-431d-be8a-0e59b8f654c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f22b85-a9fe-4f89-94d9-50c5f43ecf27]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:05:31 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:05:31 user nova-compute[75285]:  {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:05:31 user nova-compute[75285]: WARNING os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 21:05:31 user nova-compute[75285]: 
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c520d50-5fec-4767-a0f7-628e32a83159]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c0f734-67c1-4a47-92db-6412ba24bd3e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e31df1-7250-49e6-b6b3-20202d912396]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[710d5966-b8ed-4144-9297-fe9dd26a558c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343, portal: 172.16.0.220,3260]
Nov 10 21:05:31 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343, portal: 172.16.0.220,3260] successful.
Nov 10 21:05:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:05:31 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce335e5-b9d2-492c-9e32-7f172469808e]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.utils [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Updating existing volume attachment record: 4d4b799d-db31-4387-bf40-3fa56b6fc2ad {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c0c1fc-d00e-4a6a-b671-72a0e4ebe335]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c6f3e1-fc82-40f4-8d6f-90e47a358e55]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:05:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:05:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f480475c-2798-44eb-ab3c-5d7cccb0cd01]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBJvulUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.utils [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa34429-639b-46b8-94ab-9cb238bf8774]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e9a89b-2f86-4c09-955a-499b945e4ac0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.utils [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2602cfff-074d-4987-a322-c73818668d94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2796caea-b44d-458c-89ae-0064894920f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fa1449-b57f-4fd7-97ef-1664c4c88578]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbcd355-93a8-4efb-883c-12369e4b54f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:05:31 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[430a686a-19a4-457e-9f10-582494b18bd6]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.utils [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Updating existing volume attachment record: ed166cac-8b36-4851-8c36-fb1aad45397b {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae88f518-f008-4c6e-9d78-8c5c9d2f8020]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[570aa0b0-da04-41a1-8554-485234049391]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:05:31 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:05:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cd25d6-4762-49ca-9c4c-984d54139f3e]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG os_brick.utils [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:05:31 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Updating existing volume attachment record: b48004bd-946e-47d3-8df6-7b99503f7422 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjnyWUrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:05:32 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23063346532386434', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063346532386434', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.508s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:05:32 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:05:32 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG nova.objects.instance [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lazy-loading 'flavor' on Instance uuid ec5dca1b-b623-4a12-af56-aa2bce208869 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a610c34a-d29b-47f2-93c0-9a3b337d7c7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:05:32 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:05:32 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:05:32 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:05:32 user nova-compute[75285]:   <target dev="sdc" bus="scsi"/>
Nov 10 21:05:32 user nova-compute[75285]:   <serial>64aa237c-d313-4e40-85c0-a3c74ad70343</serial>
Nov 10 21:05:32 user nova-compute[75285]:   <address type="drive" controller="0" unit="2"/>
Nov 10 21:05:32 user nova-compute[75285]: </disk>
Nov 10 21:05:32 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f4e017-1425-40ee-88ac-55d16d13d99b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720] added
Nov 10 21:05:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a713e0-b8ac-4a7f-9e4c-0890b2894de8]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[057f2ec3-64e1-4303-91c2-4bc5c4fc65b1]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SjnyWUrm {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SjnyWUrm" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ed4459-0ba4-4938-9cca-c6ea896368de]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SjnyWUrm'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[775d1699-6a0a-4a28-af91-a08d83493fc5]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7376c5da-2c05-4d3c-9279-64fd8fcb8092]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:05:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:05:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2bd564-60d0-4c65-9116-46cbc8321272]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720, portal: 172.16.0.220,3260]
Nov 10 21:05:32 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720, portal: 172.16.0.220,3260] successful.
Nov 10 21:05:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddba3264-3cf9-4681-a66c-86f13fc6a7ea]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e67ba5-c79a-4057-8d5a-3b5944b24855]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:05:32 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:05:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:05:32 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:05:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef83eb5b-14c5-4fd1-8246-748ab7f64d67]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:05:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjnyWUrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:05:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] No BDM found with device name sda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:05:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:05:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:05:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] No VIF found with MAC fa:16:3e:79:58:f8, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:05:33 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:05:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:05:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] <== connect_volume: return (1830ms) {'type': 'block', 'scsi_wwn': '23637613061343633', 'path': '/dev/sdc'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:05:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637613061343633', 'path': '/dev/sdc'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:05:33 user nova-compute[75285]: DEBUG nova.objects.instance [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lazy-loading 'flavor' on Instance uuid 6db680e7-3e21-4451-a0b1-29f9eca59b2f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:05:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:05:33 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:05:33 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:05:33 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:05:33 user nova-compute[75285]:   <serial>f6242c82-7d92-4452-a904-81ab911a0720</serial>
Nov 10 21:05:33 user nova-compute[75285]: </disk>
Nov 10 21:05:33 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:05:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:05:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:05:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] No VIF found with MAC fa:16:3e:9b:b6:31, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:05:34 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:05:34 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:05:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:36 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:05:36 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:05:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:05:36 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:05:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:05:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (sdc) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:05:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:41 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:05:41 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7518MB free_disk=25.42668914794922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 02b4446d-1538-4e80-b93d-5cb904b7b98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 6db680e7-3e21-4451-a0b1-29f9eca59b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ec5dca1b-b623-4a12-af56-aa2bce208869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 431a5e3b-068c-4da3-8198-85b4dcafd266 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 82a83f12-0822-4cd0-8d1b-3f939a601745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance aa74d6a6-3084-45c9-b15a-2b831077a3ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 4ace88c2-e7f4-4ed8-8ac8-1759f160db04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:05:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:05:42 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:05:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:05:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:05:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:05:42 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:05:43 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Updating instance_info_cache with network_info: [{"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:05:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:05:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:05:43 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:05:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:05:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:05:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:05:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:05:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:05:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqDvayzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:05:59 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:05:59 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:05:59 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[998ef58b-20ec-4518-a1ac-8c4a51553487]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:05:59 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[66463290-a66d-4e34-8f94-7b09d0eff6dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b] added
Nov 10 21:05:59 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3046d10b-090c-474a-aa79-054f20599e6c]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZdEGvyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:05:59 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[14966b9a-9a5b-41f0-88ae-8846d89f867f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqDvayzZ {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqDvayzZ" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fe197c-6dd7-493c-9552-aff5eb01dff7]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PqDvayzZ'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[12762fed-8524-4b49-a4b8-46f1eab0a1b3]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e02c9e8-61be-4102-8086-174d7e882db3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:05:59 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:05:59 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:05:59 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:05:59 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a173ee9f-7e73-4d1a-9526-5d9854857b91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b, portal: 172.16.0.220,3260]
Nov 10 21:05:59 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b, portal: 172.16.0.220,3260] successful.
Nov 10 21:05:59 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff84a6db-a209-40f3-a400-7f88e724be3a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c8dbf8-4907-48fb-87d4-de1182269c6e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:05:59 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:05:59 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:05:59 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:05:59 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:05:59 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:05:59 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c8f56e-e996-4785-b41f-27ad9ed27096]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:05:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqDvayzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be08cb8a-a2f8-4cff-b090-bfacd97d58ba tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 56.092s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcc6dd9a-4e98-4141-b450-4c488fd1d706 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 55.501s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23830626235626134', 'path': '/dev/sdd'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830626235626134', 'path': '/dev/sdd'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.253s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:00 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:00 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG nova.objects.instance [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lazy-loading 'flavor' on Instance uuid 431a5e3b-068c-4da3-8198-85b4dcafd266 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[230e51f0-1ace-4f1c-bc29-bc51162dbed7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:06:00 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:06:00 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:06:00 user nova-compute[75285]:   <source dev="/dev/sdd"/>
Nov 10 21:06:00 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:06:00 user nova-compute[75285]:   <serial>e77d5094-24a5-4e04-9554-d82a6274d01b</serial>
Nov 10 21:06:00 user nova-compute[75285]: </disk>
Nov 10 21:06:00 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1803465f-ed15-4a67-a750-011266f64146]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec] added
Nov 10 21:06:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[753d69d8-a489-4222-8e2e-3289efdc5c35]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb418b33-4e5e-439b-b1f9-032826d8c26a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZdEGvyL {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZdEGvyL" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a2119d-7420-4138-b4c1-fd53e5d48b41]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xZdEGvyL'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbb2d8f-cc87-4cd5-9ef7-ce808bce0eab]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[445b57b0-cc38-45f9-9268-b6d091fe7b4d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:00 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:00 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:00 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:00 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[41659af6-aea3-4f9b-88d4-d91d94a67fac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260]
Nov 10 21:06:00 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260] successful.
Nov 10 21:06:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bac7f1-cddb-49f4-ac83-18ddf8b92115]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[379da831-3f3c-4475-97af-3f6128130649]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:00 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:00 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:00 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:00 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:00 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:00 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9539e212-f851-44e8-b56f-e89751f699c7]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:06:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZdEGvyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:06:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:06:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] No BDM found with device name hda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:06:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] No VIF found with MAC fa:16:3e:06:22:3a, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:06:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-35571268-b6c3-45d5-87f6-e266d19b813b tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.211s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "ec5dca1b-b623-4a12-af56-aa2bce208869" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:01 user nova-compute[75285]: INFO nova.compute.manager [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Detaching volume 64aa237c-d313-4e40-85c0-a3c74ad70343
Nov 10 21:06:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] <== connect_volume: return (2680ms) {'type': 'block', 'scsi_wwn': '23661643861373463', 'path': '/dev/sde'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661643861373463', 'path': '/dev/sde'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:06:02 user nova-compute[75285]: DEBUG nova.objects.instance [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lazy-loading 'flavor' on Instance uuid 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:06:02 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:06:02 user nova-compute[75285]:   <source dev="/dev/sde"/>
Nov 10 21:06:02 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:06:02 user nova-compute[75285]:   <serial>7e4cfc71-aa34-4830-b7d4-c49ece3e3cec</serial>
Nov 10 21:06:02 user nova-compute[75285]: </disk>
Nov 10 21:06:02 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:06:02 user nova-compute[75285]: INFO nova.virt.block_device [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Attempting to driver detach volume 64aa237c-d313-4e40-85c0-a3c74ad70343 from mountpoint /dev/sdc
Nov 10 21:06:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Attempting to detach device sdc from instance ec5dca1b-b623-4a12-af56-aa2bce208869 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:06:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:06:02 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:06:02 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:06:02 user nova-compute[75285]:   <target dev="sdc" bus="scsi"/>
Nov 10 21:06:02 user nova-compute[75285]:   <serial>64aa237c-d313-4e40-85c0-a3c74ad70343</serial>
Nov 10 21:06:02 user nova-compute[75285]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 10 21:06:02 user nova-compute[75285]: </disk>
Nov 10 21:06:02 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:06:02 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Successfully detached device sdc from instance ec5dca1b-b623-4a12-af56-aa2bce208869 from the persistent domain config.
Nov 10 21:06:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ec5dca1b-b623-4a12-af56-aa2bce208869 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:06:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:06:02 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:06:02 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:06:02 user nova-compute[75285]:   <target dev="sdc" bus="scsi"/>
Nov 10 21:06:02 user nova-compute[75285]:   <serial>64aa237c-d313-4e40-85c0-a3c74ad70343</serial>
Nov 10 21:06:02 user nova-compute[75285]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 10 21:06:02 user nova-compute[75285]: </disk>
Nov 10 21:06:02 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:06:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:06:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:06:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] No VIF found with MAC fa:16:3e:1f:23:b7, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:06:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-36720193-709a-4559-8e1e-d3beed001ead tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.763s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ec5dca1b-b623-4a12-af56-aa2bce208869 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:06:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:02 user nova-compute[75285]: INFO nova.compute.manager [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Detaching volume f6242c82-7d92-4452-a904-81ab911a0720
Nov 10 21:06:03 user nova-compute[75285]: INFO nova.virt.block_device [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Attempting to driver detach volume f6242c82-7d92-4452-a904-81ab911a0720 from mountpoint /dev/vdb
Nov 10 21:06:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Attempting to detach device vdb from instance 6db680e7-3e21-4451-a0b1-29f9eca59b2f from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:06:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:06:03 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:06:03 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:06:03 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:06:03 user nova-compute[75285]:   <serial>f6242c82-7d92-4452-a904-81ab911a0720</serial>
Nov 10 21:06:03 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:06:03 user nova-compute[75285]: </disk>
Nov 10 21:06:03 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:06:03 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Successfully detached device vdb from instance 6db680e7-3e21-4451-a0b1-29f9eca59b2f from the persistent domain config.
Nov 10 21:06:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6db680e7-3e21-4451-a0b1-29f9eca59b2f from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:06:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:06:03 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:06:03 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:06:03 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:06:03 user nova-compute[75285]:   <serial>f6242c82-7d92-4452-a904-81ab911a0720</serial>
Nov 10 21:06:03 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:06:03 user nova-compute[75285]: </disk>
Nov 10 21:06:03 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:06:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "431a5e3b-068c-4da3-8198-85b4dcafd266" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:03 user nova-compute[75285]: INFO nova.compute.manager [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Detaching volume e77d5094-24a5-4e04-9554-d82a6274d01b
Nov 10 21:06:03 user nova-compute[75285]: INFO nova.virt.block_device [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Attempting to driver detach volume e77d5094-24a5-4e04-9554-d82a6274d01b from mountpoint /dev/vdb
Nov 10 21:06:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Attempting to detach device vdb from instance 431a5e3b-068c-4da3-8198-85b4dcafd266 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:06:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:06:03 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:06:03 user nova-compute[75285]:   <source dev="/dev/sdd"/>
Nov 10 21:06:03 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:06:03 user nova-compute[75285]:   <serial>e77d5094-24a5-4e04-9554-d82a6274d01b</serial>
Nov 10 21:06:03 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 21:06:03 user nova-compute[75285]: </disk>
Nov 10 21:06:03 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:06:03 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Successfully detached device vdb from instance 431a5e3b-068c-4da3-8198-85b4dcafd266 from the persistent domain config.
Nov 10 21:06:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 431a5e3b-068c-4da3-8198-85b4dcafd266 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:06:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:06:03 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:06:03 user nova-compute[75285]:   <source dev="/dev/sdd"/>
Nov 10 21:06:03 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:06:03 user nova-compute[75285]:   <serial>e77d5094-24a5-4e04-9554-d82a6274d01b</serial>
Nov 10 21:06:03 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 21:06:03 user nova-compute[75285]: </disk>
Nov 10 21:06:03 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:06:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6db680e7-3e21-4451-a0b1-29f9eca59b2f {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 431a5e3b-068c-4da3-8198-85b4dcafd266 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG os_brick.utils [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aa2101-e0e6-4496-99cd-b1ad27032448]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9af61ff-0685-4411-8e73-45847cf6ab68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[501be310-918b-415b-9136-0ead2771c90c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ac3238-3153-444b-b3ea-9ba814c912c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:06:04 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:06:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[00520ea3-17ca-4ba7-a4be-e17bfc096685]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:06:04 user nova-compute[75285]: DEBUG os_brick.utils [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:04 user nova-compute[75285]: INFO nova.compute.manager [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Swapping volume 7e4cfc71-aa34-4830-b7d4-c49ece3e3cec for e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd
Nov 10 21:06:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Acquiring lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lazy-loading 'flavor' on Instance uuid 02b4446d-1538-4e80-b93d-5cb904b7b98f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:06:13 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Creating image(s)
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Did not create local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Ensure instance console log exists: /opt/stack/data/nova/instances/aa74d6a6-3084-45c9-b15a-2b831077a3ac/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Start _get_guest_xml network_info=[{"id": "99435856-9d26-448e-87de-b0ca7e110d7e", "address": "fa:16:3e:fe:af:16", "network": {"id": "50305b49-f0da-4a31-aa59-afec3d63b685", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2066917041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99435856-9d", "ovs_interfaceid": "99435856-9d26-448e-87de-b0ca7e110d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "address": "fa:16:3e:c9:0b:3c", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa285a3dc-41", "ovs_interfaceid": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "address": "fa:16:3e:17:7f:91", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007fd357-23", "ovs_interfaceid": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "address": "fa:16:3e:f3:38:05", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6c95f2-fe", "ovs_interfaceid": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "address": "fa:16:3e:41:2d:eb", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee974a9-ab", "ovs_interfaceid": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "address": "fa:16:3e:36:9a:af", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef2795ba-d5", "ovs_interfaceid": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "875dac5e-5dc7-45f9-befe-a128379298e1", "address": "fa:16:3e:98:b0:ab", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875dac5e-5d", "ovs_interfaceid": "875dac5e-5dc7-45f9-befe-a128379298e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '7a8420b0-9536-4ca4-b826-94bb16f15a10', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPHsZqJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa74d6a6-3084-45c9-b15a-2b831077a3ac', 'attached_at': '', 'detached_at': '', 'volume_id': '6eae897f-a431-47f8-a064-f82680de5b89', 'serial': '6eae897f-a431-47f8-a064-f82680de5b89'}, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '3f8b8551-3b52-43bc-a2a9-2dcd7eedf5be', 'boot_index': 1, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgoNPUdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa74d6a6-3084-45c9-b15a-2b831077a3ac', 'attached_at': '', 'detached_at': '', 'volume_id': '9d7ed375-8c35-4522-8f63-bcdf78c5ca8d', 'serial': '9d7ed375-8c35-4522-8f63-bcdf78c5ca8d'}, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '4582e7eb-ea0a-4e04-bef3-865285c65952', 'boot_index': 2, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDEOnSoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa74d6a6-3084-45c9-b15a-2b831077a3ac', 'attached_at': '', 'detached_at': '', 'volume_id': '63c74ae0-495c-4359-aef0-ebd1c41a5b85', 'serial': '63c74ae0-495c-4359-aef0-ebd1c41a5b85'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:06:13 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:06:13 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPHsZqJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:06:13 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:13 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:13 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[47aeca59-c78d-4593-8dfe-ae6024376e46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:06:13 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc58b423-baea-48f7-b4e1-887f3fdedbf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89] added
Nov 10 21:06:13 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ff5674-98bb-404b-b04e-3a1ab02b6158]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6105dd3-3b3a-41ce-af61-2e4f4eb3bca8]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPHsZqJn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPHsZqJn" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b26845a-7456-4988-9b2a-63ec0fb33c8d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VPHsZqJn'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebb0c1c-af17-44f0-be65-541bf4086693]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fef6b4-11fa-46b7-a663-579250d3694b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:13 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:13 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:13 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:13 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:13 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:13 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:13 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:13 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c64de45-276f-4b03-94cf-911e75cbd01a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89, portal: 172.16.0.220,3260]
Nov 10 21:06:13 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89, portal: 172.16.0.220,3260] successful.
Nov 10 21:06:13 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Acquiring lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:13 user nova-compute[75285]: INFO nova.compute.manager [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Attaching volume a10c02ba-99bb-4c32-bef2-90c1d9ef1272 to /dev/vdb
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb75f5b-027e-48fc-8e24-ca3ad5ac45f8]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[44374f60-00f4-4e68-b7b7-416ab23b6e26]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:13 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:13 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:13 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:13 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:13 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:13 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:13 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:13 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:13 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:13 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf280e02-d08f-4855-b053-e6e7959c49e1]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPHsZqJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.utils [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9197a4d-f908-4163-a8b3-667b567b251b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7157737f-8906-4309-a6de-90fc56549727]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45896d9-445e-4737-98b1-813c01970ddf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdbeb0d-9339-4060-9c37-6d0fbf7dc4fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:06:13 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:06:13 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5546c2a-3d95-4613-9bab-aca99f54e717]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG os_brick.utils [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:13 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Updating existing volume attachment record: dbdc84df-5dda-4c53-aa48-27b8ddf82b3c {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23562663438323431', 'path': '/dev/sdf'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562663438323431', 'path': '/dev/sdf'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgoNPUdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:06:14 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:14 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:14 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84891df-d653-433c-9aa6-f5f95f4d6b20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:06:14 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[66af4c81-11ce-4cf7-bdc0-2703d8a5158f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d] added
Nov 10 21:06:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce11141-79fe-464a-9d25-9dbe07af0ba6]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be40268-0846-4503-8532-2497e36aedbb]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgoNPUdp {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgoNPUdp" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5553880-ba99-43ee-9a15-93241a75289d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VgoNPUdp'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcc808b-a994-4e01-ab7f-37981fa62a37]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4859b466-97d8-4c30-98cb-ebfecc5d8ed0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b064cc3a-a77e-4609-971b-f4566d4f0f00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d, portal: 172.16.0.220,3260]
Nov 10 21:06:14 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d, portal: 172.16.0.220,3260] successful.
Nov 10 21:06:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8354695-7c8b-4d86-a9ae-394f5a60d84a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[df92c35a-f836-4bf7-90b1-1f3ae9f327d5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:14 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[286c09f1-868e-4626-bb27-d5fcfed132c9]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:06:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:15 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:06:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgoNPUdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:06:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26664343634323631', 'path': '/dev/sdg'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664343634323631', 'path': '/dev/sdg'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDEOnSoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:06:16 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:16 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:16 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd79db2-992a-4c8b-9518-a28e832184d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:06:16 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab58c0f1-3120-4f67-bb31-2e5f895b082e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85] added
Nov 10 21:06:16 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9098cf-3d6f-4d50-90f0-9a86458f3219]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c803c397-c9dc-42c0-92a5-5406c223ef89]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDEOnSoI {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDEOnSoI" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a07439f-d3da-4e4e-9517-812ddbadc2a5]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lDEOnSoI'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[116e48c2-14b4-47f3-a75b-e5821abd806f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a98a87-cbce-48ed-88ab-e326e1b6cc41]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:16 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:16 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90ef711-8cc3-4625-822d-7b06e9dbc371]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85, portal: 172.16.0.220,3260]
Nov 10 21:06:16 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85, portal: 172.16.0.220,3260] successful.
Nov 10 21:06:16 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f3112a-6c2b-4ce1-88aa-995c3e54a261]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d69b48f-f3b7-4c4b-8165-db22b271f289]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:16 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:16 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:16 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1845684d-e180-4712-9b0c-4c9b34436617]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:06:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDEOnSoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23166386139663261', 'path': '/dev/sdh'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166386139663261', 'path': '/dev/sdh'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99435856-9d26-448e-87de-b0ca7e110d7e", "address": "fa:16:3e:fe:af:16", "network": {"id": "50305b49-f0da-4a31-aa59-afec3d63b685", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2066917041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99435856-9d", "ovs_interfaceid": "99435856-9d26-448e-87de-b0ca7e110d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "99435856-9d26-448e-87de-b0ca7e110d7e", "address": "fa:16:3e:fe:af:16", "network": {"id": "50305b49-f0da-4a31-aa59-afec3d63b685", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2066917041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99435856-9d", "ovs_interfaceid": "99435856-9d26-448e-87de-b0ca7e110d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:af:16,bridge_name='br-int',has_traffic_filtering=True,id=99435856-9d26-448e-87de-b0ca7e110d7e,network=Network(50305b49-f0da-4a31-aa59-afec3d63b685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99435856-9d') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "address": "fa:16:3e:c9:0b:3c", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa285a3dc-41", "ovs_interfaceid": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "address": "fa:16:3e:c9:0b:3c", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa285a3dc-41", "ovs_interfaceid": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0b:3c,bridge_name='br-int',has_traffic_filtering=True,id=a285a3dc-41b1-41f5-8f7f-693f74e288ad,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa285a3dc-41') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "address": "fa:16:3e:17:7f:91", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007fd357-23", "ovs_interfaceid": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "address": "fa:16:3e:17:7f:91", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007fd357-23", "ovs_interfaceid": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:7f:91,bridge_name='br-int',has_traffic_filtering=True,id=007fd357-2314-47ad-9e02-0e30f5e6dd09,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap007fd357-23') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "address": "fa:16:3e:f3:38:05", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6c95f2-fe", "ovs_interfaceid": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "address": "fa:16:3e:f3:38:05", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6c95f2-fe", "ovs_interfaceid": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:38:05,bridge_name='br-int',has_traffic_filtering=True,id=fb6c95f2-fe2f-488b-8119-6cc8158f90a5,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6c95f2-fe') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "address": "fa:16:3e:41:2d:eb", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee974a9-ab", "ovs_interfaceid": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "address": "fa:16:3e:41:2d:eb", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee974a9-ab", "ovs_interfaceid": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:2d:eb,bridge_name='br-int',has_traffic_filtering=True,id=3ee974a9-ab23-4c8b-99c3-3e0823cccfaf,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee974a9-ab') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "address": "fa:16:3e:36:9a:af", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef2795ba-d5", "ovs_interfaceid": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "address": "fa:16:3e:36:9a:af", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef2795ba-d5", "ovs_interfaceid": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9a:af,bridge_name='br-int',has_traffic_filtering=True,id=ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d,network=Network(6746c947-a1e1-44d7-94c8-69098fb5fce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef2795ba-d5') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "875dac5e-5dc7-45f9-befe-a128379298e1", "address": "fa:16:3e:98:b0:ab", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875dac5e-5d", "ovs_interfaceid": "875dac5e-5dc7-45f9-befe-a128379298e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "875dac5e-5dc7-45f9-befe-a128379298e1", "address": "fa:16:3e:98:b0:ab", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875dac5e-5d", "ovs_interfaceid": "875dac5e-5dc7-45f9-befe-a128379298e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b0:ab,bridge_name='br-int',has_traffic_filtering=True,id=875dac5e-5dc7-45f9-befe-a128379298e1,network=Network(6746c947-a1e1-44d7-94c8-69098fb5fce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875dac5e-5d') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lazy-loading 'pci_devices' on Instance uuid aa74d6a6-3084-45c9-b15a-2b831077a3ac {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:06:17 user nova-compute[75285]:   <uuid>aa74d6a6-3084-45c9-b15a-2b831077a3ac</uuid>
Nov 10 21:06:17 user nova-compute[75285]:   <name>instance-00000009</name>
Nov 10 21:06:17 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:06:17 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:06:17 user nova-compute[75285]:   <metadata>
Nov 10 21:06:17 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:06:17 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:06:17 user nova-compute[75285]:       <nova:name>tempest-device-tagging-server-799322528</nova:name>
Nov 10 21:06:17 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:06:13</nova:creationTime>
Nov 10 21:06:17 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:06:17 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:06:17 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:06:17 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:06:17 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:06:17 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:06:17 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:06:17 user nova-compute[75285]:       <nova:owner>
Nov 10 21:06:17 user nova-compute[75285]:         <nova:user uuid="14517e31ebb14b2aa08eaa4c7903cf75">tempest-TaggedBootDevicesTest_v242-280000780-project-member</nova:user>
Nov 10 21:06:17 user nova-compute[75285]:         <nova:project uuid="5d8ea660e66943cca0d07c83d14612c7">tempest-TaggedBootDevicesTest_v242-280000780</nova:project>
Nov 10 21:06:17 user nova-compute[75285]:       </nova:owner>
Nov 10 21:06:17 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:06:17 user nova-compute[75285]:       <nova:ports>
Nov 10 21:06:17 user nova-compute[75285]:         <nova:port uuid="99435856-9d26-448e-87de-b0ca7e110d7e">
Nov 10 21:06:17 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 21:06:17 user nova-compute[75285]:         </nova:port>
Nov 10 21:06:17 user nova-compute[75285]:         <nova:port uuid="a285a3dc-41b1-41f5-8f7f-693f74e288ad">
Nov 10 21:06:17 user nova-compute[75285]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Nov 10 21:06:17 user nova-compute[75285]:         </nova:port>
Nov 10 21:06:17 user nova-compute[75285]:         <nova:port uuid="007fd357-2314-47ad-9e02-0e30f5e6dd09">
Nov 10 21:06:17 user nova-compute[75285]:           <nova:ip type="fixed" address="10.1.1.219" ipVersion="4"/>
Nov 10 21:06:17 user nova-compute[75285]:         </nova:port>
Nov 10 21:06:17 user nova-compute[75285]:         <nova:port uuid="fb6c95f2-fe2f-488b-8119-6cc8158f90a5">
Nov 10 21:06:17 user nova-compute[75285]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Nov 10 21:06:17 user nova-compute[75285]:         </nova:port>
Nov 10 21:06:17 user nova-compute[75285]:         <nova:port uuid="3ee974a9-ab23-4c8b-99c3-3e0823cccfaf">
Nov 10 21:06:17 user nova-compute[75285]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Nov 10 21:06:17 user nova-compute[75285]:         </nova:port>
Nov 10 21:06:17 user nova-compute[75285]:         <nova:port uuid="ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d">
Nov 10 21:06:17 user nova-compute[75285]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 10 21:06:17 user nova-compute[75285]:         </nova:port>
Nov 10 21:06:17 user nova-compute[75285]:         <nova:port uuid="875dac5e-5dc7-45f9-befe-a128379298e1">
Nov 10 21:06:17 user nova-compute[75285]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 10 21:06:17 user nova-compute[75285]:         </nova:port>
Nov 10 21:06:17 user nova-compute[75285]:       </nova:ports>
Nov 10 21:06:17 user nova-compute[75285]:     </nova:instance>
Nov 10 21:06:17 user nova-compute[75285]:   </metadata>
Nov 10 21:06:17 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:06:17 user nova-compute[75285]:     <system>
Nov 10 21:06:17 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:06:17 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:06:17 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:06:17 user nova-compute[75285]:       <entry name="serial">aa74d6a6-3084-45c9-b15a-2b831077a3ac</entry>
Nov 10 21:06:17 user nova-compute[75285]:       <entry name="uuid">aa74d6a6-3084-45c9-b15a-2b831077a3ac</entry>
Nov 10 21:06:17 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:06:17 user nova-compute[75285]:     </system>
Nov 10 21:06:17 user nova-compute[75285]:   </sysinfo>
Nov 10 21:06:17 user nova-compute[75285]:   <os>
Nov 10 21:06:17 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:06:17 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:06:17 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:06:17 user nova-compute[75285]:   </os>
Nov 10 21:06:17 user nova-compute[75285]:   <features>
Nov 10 21:06:17 user nova-compute[75285]:     <acpi/>
Nov 10 21:06:17 user nova-compute[75285]:     <apic/>
Nov 10 21:06:17 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:06:17 user nova-compute[75285]:   </features>
Nov 10 21:06:17 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:06:17 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:06:17 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:06:17 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:06:17 user nova-compute[75285]:   </clock>
Nov 10 21:06:17 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:06:17 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:06:17 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:06:17 user nova-compute[75285]:   </cpu>
Nov 10 21:06:17 user nova-compute[75285]:   <devices>
Nov 10 21:06:17 user nova-compute[75285]:     <disk type="file" device="cdrom">
Nov 10 21:06:17 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 21:06:17 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/aa74d6a6-3084-45c9-b15a-2b831077a3ac/disk.config"/>
Nov 10 21:06:17 user nova-compute[75285]:       <target dev="hda" bus="ide"/>
Nov 10 21:06:17 user nova-compute[75285]:     </disk>
Nov 10 21:06:17 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:06:17 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:06:17 user nova-compute[75285]:       <source dev="/dev/sdf"/>
Nov 10 21:06:17 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:06:17 user nova-compute[75285]:       <serial>6eae897f-a431-47f8-a064-f82680de5b89</serial>
Nov 10 21:06:17 user nova-compute[75285]:     </disk>
Nov 10 21:06:17 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:06:17 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:06:17 user nova-compute[75285]:       <source dev="/dev/sdg"/>
Nov 10 21:06:17 user nova-compute[75285]:       <target dev="vdb" bus="virtio"/>
Nov 10 21:06:17 user nova-compute[75285]:       <serial>9d7ed375-8c35-4522-8f63-bcdf78c5ca8d</serial>
Nov 10 21:06:17 user nova-compute[75285]:     </disk>
Nov 10 21:06:17 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:06:17 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:06:17 user nova-compute[75285]:       <source dev="/dev/sdh"/>
Nov 10 21:06:17 user nova-compute[75285]:       <target dev="vdc" bus="virtio"/>
Nov 10 21:06:17 user nova-compute[75285]:       <serial>63c74ae0-495c-4359-aef0-ebd1c41a5b85</serial>
Nov 10 21:06:17 user nova-compute[75285]:     </disk>
Nov 10 21:06:17 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:06:17 user nova-compute[75285]:       <mac address="fa:16:3e:fe:af:16"/>
Nov 10 21:06:17 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:06:17 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:06:17 user nova-compute[75285]:       <target dev="tap99435856-9d"/>
Nov 10 21:06:17 user nova-compute[75285]:     </interface>
Nov 10 21:06:17 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:06:17 user nova-compute[75285]:       <mac address="fa:16:3e:c9:0b:3c"/>
Nov 10 21:06:17 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:06:17 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:06:17 user nova-compute[75285]:       <target dev="tapa285a3dc-41"/>
Nov 10 21:06:17 user nova-compute[75285]:     </interface>
Nov 10 21:06:17 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:06:17 user nova-compute[75285]:       <mac address="fa:16:3e:17:7f:91"/>
Nov 10 21:06:17 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:06:17 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:06:17 user nova-compute[75285]:       <target dev="tap007fd357-23"/>
Nov 10 21:06:17 user nova-compute[75285]:     </interface>
Nov 10 21:06:17 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:06:17 user nova-compute[75285]:       <mac address="fa:16:3e:f3:38:05"/>
Nov 10 21:06:17 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:06:17 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:06:17 user nova-compute[75285]:       <target dev="tapfb6c95f2-fe"/>
Nov 10 21:06:17 user nova-compute[75285]:     </interface>
Nov 10 21:06:17 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:06:17 user nova-compute[75285]:       <mac address="fa:16:3e:41:2d:eb"/>
Nov 10 21:06:17 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:06:17 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:06:17 user nova-compute[75285]:       <target dev="tap3ee974a9-ab"/>
Nov 10 21:06:17 user nova-compute[75285]:     </interface>
Nov 10 21:06:17 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:06:17 user nova-compute[75285]:       <mac address="fa:16:3e:36:9a:af"/>
Nov 10 21:06:17 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:06:17 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:06:17 user nova-compute[75285]:       <target dev="tapef2795ba-d5"/>
Nov 10 21:06:17 user nova-compute[75285]:     </interface>
Nov 10 21:06:17 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:06:17 user nova-compute[75285]:       <mac address="fa:16:3e:98:b0:ab"/>
Nov 10 21:06:17 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:06:17 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:06:17 user nova-compute[75285]:       <target dev="tap875dac5e-5d"/>
Nov 10 21:06:17 user nova-compute[75285]:     </interface>
Nov 10 21:06:17 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:06:17 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/aa74d6a6-3084-45c9-b15a-2b831077a3ac/console.log" append="off"/>
Nov 10 21:06:17 user nova-compute[75285]:     </serial>
Nov 10 21:06:17 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:06:17 user nova-compute[75285]:     <video>
Nov 10 21:06:17 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:06:17 user nova-compute[75285]:     </video>
Nov 10 21:06:17 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:06:17 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:06:17 user nova-compute[75285]:     </rng>
Nov 10 21:06:17 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:06:17 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:06:17 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:06:17 user nova-compute[75285]:     </memballoon>
Nov 10 21:06:17 user nova-compute[75285]:   </devices>
Nov 10 21:06:17 user nova-compute[75285]: </domain>
Nov 10 21:06:17 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99435856-9d26-448e-87de-b0ca7e110d7e", "address": "fa:16:3e:fe:af:16", "network": {"id": "50305b49-f0da-4a31-aa59-afec3d63b685", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2066917041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99435856-9d", "ovs_interfaceid": "99435856-9d26-448e-87de-b0ca7e110d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "99435856-9d26-448e-87de-b0ca7e110d7e", "address": "fa:16:3e:fe:af:16", "network": {"id": "50305b49-f0da-4a31-aa59-afec3d63b685", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2066917041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99435856-9d", "ovs_interfaceid": "99435856-9d26-448e-87de-b0ca7e110d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:af:16,bridge_name='br-int',has_traffic_filtering=True,id=99435856-9d26-448e-87de-b0ca7e110d7e,network=Network(50305b49-f0da-4a31-aa59-afec3d63b685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99435856-9d') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG os_vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:af:16,bridge_name='br-int',has_traffic_filtering=True,id=99435856-9d26-448e-87de-b0ca7e110d7e,network=Network(50305b49-f0da-4a31-aa59-afec3d63b685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99435856-9d') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c9ff74f-8db1-5184-84f6-193a11e2df12', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99435856-9d, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99435856-9d, col_values=(('qos', UUID('8ab4bddc-98f1-4f44-9f62-bb9c9ad7c583')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99435856-9d, col_values=(('external_ids', {'iface-id': '99435856-9d26-448e-87de-b0ca7e110d7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:af:16', 'vm-uuid': 'aa74d6a6-3084-45c9-b15a-2b831077a3ac'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: INFO os_vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:af:16,bridge_name='br-int',has_traffic_filtering=True,id=99435856-9d26-448e-87de-b0ca7e110d7e,network=Network(50305b49-f0da-4a31-aa59-afec3d63b685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99435856-9d')
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "address": "fa:16:3e:c9:0b:3c", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa285a3dc-41", "ovs_interfaceid": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "address": "fa:16:3e:c9:0b:3c", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa285a3dc-41", "ovs_interfaceid": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0b:3c,bridge_name='br-int',has_traffic_filtering=True,id=a285a3dc-41b1-41f5-8f7f-693f74e288ad,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa285a3dc-41') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG os_vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0b:3c,bridge_name='br-int',has_traffic_filtering=True,id=a285a3dc-41b1-41f5-8f7f-693f74e288ad,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa285a3dc-41') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a1f623d-d390-5751-b3d0-aa0659cc82db', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa285a3dc-41, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa285a3dc-41, col_values=(('qos', UUID('782c2c3c-d748-4070-902e-40537715a8fa')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa285a3dc-41, col_values=(('external_ids', {'iface-id': 'a285a3dc-41b1-41f5-8f7f-693f74e288ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:0b:3c', 'vm-uuid': 'aa74d6a6-3084-45c9-b15a-2b831077a3ac'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: INFO os_vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0b:3c,bridge_name='br-int',has_traffic_filtering=True,id=a285a3dc-41b1-41f5-8f7f-693f74e288ad,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa285a3dc-41')
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "address": "fa:16:3e:17:7f:91", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007fd357-23", "ovs_interfaceid": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "address": "fa:16:3e:17:7f:91", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007fd357-23", "ovs_interfaceid": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:7f:91,bridge_name='br-int',has_traffic_filtering=True,id=007fd357-2314-47ad-9e02-0e30f5e6dd09,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap007fd357-23') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG os_vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:7f:91,bridge_name='br-int',has_traffic_filtering=True,id=007fd357-2314-47ad-9e02-0e30f5e6dd09,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap007fd357-23') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fb53438-00eb-52f0-8044-7014f1156d27', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap007fd357-23, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap007fd357-23, col_values=(('qos', UUID('5e5d3530-500d-4d82-bbb3-425059630b2c')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap007fd357-23, col_values=(('external_ids', {'iface-id': '007fd357-2314-47ad-9e02-0e30f5e6dd09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:7f:91', 'vm-uuid': 'aa74d6a6-3084-45c9-b15a-2b831077a3ac'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: INFO os_vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:7f:91,bridge_name='br-int',has_traffic_filtering=True,id=007fd357-2314-47ad-9e02-0e30f5e6dd09,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap007fd357-23')
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "address": "fa:16:3e:f3:38:05", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6c95f2-fe", "ovs_interfaceid": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "address": "fa:16:3e:f3:38:05", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6c95f2-fe", "ovs_interfaceid": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:38:05,bridge_name='br-int',has_traffic_filtering=True,id=fb6c95f2-fe2f-488b-8119-6cc8158f90a5,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6c95f2-fe') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG os_vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:38:05,bridge_name='br-int',has_traffic_filtering=True,id=fb6c95f2-fe2f-488b-8119-6cc8158f90a5,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6c95f2-fe') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f08254e-5e2c-5cea-a594-fc4d5e17b919', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb6c95f2-fe, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb6c95f2-fe, col_values=(('qos', UUID('1803c779-8a27-4645-a63c-2543f9cb7008')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb6c95f2-fe, col_values=(('external_ids', {'iface-id': 'fb6c95f2-fe2f-488b-8119-6cc8158f90a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:38:05', 'vm-uuid': 'aa74d6a6-3084-45c9-b15a-2b831077a3ac'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: INFO os_vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:38:05,bridge_name='br-int',has_traffic_filtering=True,id=fb6c95f2-fe2f-488b-8119-6cc8158f90a5,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6c95f2-fe')
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "address": "fa:16:3e:41:2d:eb", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee974a9-ab", "ovs_interfaceid": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "address": "fa:16:3e:41:2d:eb", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee974a9-ab", "ovs_interfaceid": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:2d:eb,bridge_name='br-int',has_traffic_filtering=True,id=3ee974a9-ab23-4c8b-99c3-3e0823cccfaf,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee974a9-ab') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG os_vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:2d:eb,bridge_name='br-int',has_traffic_filtering=True,id=3ee974a9-ab23-4c8b-99c3-3e0823cccfaf,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee974a9-ab') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79a4466d-7f03-55d4-bd98-707be8313450', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ee974a9-ab, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ee974a9-ab, col_values=(('qos', UUID('d00b95a7-01ee-4c74-9fe2-e6d70280e54a')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ee974a9-ab, col_values=(('external_ids', {'iface-id': '3ee974a9-ab23-4c8b-99c3-3e0823cccfaf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:2d:eb', 'vm-uuid': 'aa74d6a6-3084-45c9-b15a-2b831077a3ac'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: INFO os_vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:2d:eb,bridge_name='br-int',has_traffic_filtering=True,id=3ee974a9-ab23-4c8b-99c3-3e0823cccfaf,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee974a9-ab')
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "address": "fa:16:3e:36:9a:af", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef2795ba-d5", "ovs_interfaceid": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "address": "fa:16:3e:36:9a:af", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef2795ba-d5", "ovs_interfaceid": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9a:af,bridge_name='br-int',has_traffic_filtering=True,id=ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d,network=Network(6746c947-a1e1-44d7-94c8-69098fb5fce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef2795ba-d5') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG os_vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9a:af,bridge_name='br-int',has_traffic_filtering=True,id=ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d,network=Network(6746c947-a1e1-44d7-94c8-69098fb5fce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef2795ba-d5') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf3120a4-f403-576a-aadb-cfe2f0471d5b', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef2795ba-d5, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef2795ba-d5, col_values=(('qos', UUID('1cfeb73e-9004-4973-9a40-48ec311a4c42')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef2795ba-d5, col_values=(('external_ids', {'iface-id': 'ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:9a:af', 'vm-uuid': 'aa74d6a6-3084-45c9-b15a-2b831077a3ac'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: INFO os_vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9a:af,bridge_name='br-int',has_traffic_filtering=True,id=ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d,network=Network(6746c947-a1e1-44d7-94c8-69098fb5fce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef2795ba-d5')
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "875dac5e-5dc7-45f9-befe-a128379298e1", "address": "fa:16:3e:98:b0:ab", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875dac5e-5d", "ovs_interfaceid": "875dac5e-5dc7-45f9-befe-a128379298e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "875dac5e-5dc7-45f9-befe-a128379298e1", "address": "fa:16:3e:98:b0:ab", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875dac5e-5d", "ovs_interfaceid": "875dac5e-5dc7-45f9-befe-a128379298e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b0:ab,bridge_name='br-int',has_traffic_filtering=True,id=875dac5e-5dc7-45f9-befe-a128379298e1,network=Network(6746c947-a1e1-44d7-94c8-69098fb5fce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875dac5e-5d') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG os_vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b0:ab,bridge_name='br-int',has_traffic_filtering=True,id=875dac5e-5dc7-45f9-befe-a128379298e1,network=Network(6746c947-a1e1-44d7-94c8-69098fb5fce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875dac5e-5d') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd75ad989-a9b3-5b0b-a76f-cafaeed2e715', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap875dac5e-5d, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap875dac5e-5d, col_values=(('qos', UUID('9fad8cc5-a50b-4ceb-952a-4c2906b9cd42')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap875dac5e-5d, col_values=(('external_ids', {'iface-id': '875dac5e-5dc7-45f9-befe-a128379298e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:b0:ab', 'vm-uuid': 'aa74d6a6-3084-45c9-b15a-2b831077a3ac'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:18 user nova-compute[75285]: INFO os_vif [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b0:ab,bridge_name='br-int',has_traffic_filtering=True,id=875dac5e-5dc7-45f9-befe-a128379298e1,network=Network(6746c947-a1e1-44d7-94c8-69098fb5fce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875dac5e-5d')
Nov 10 21:06:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] No BDM found with device name hda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:06:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:06:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] No VIF found with MAC fa:16:3e:fe:af:16, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:06:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] No VIF found with MAC fa:16:3e:41:2d:eb, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:06:18 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Using config drive
Nov 10 21:06:18 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Creating config drive at /opt/stack/data/nova/instances/aa74d6a6-3084-45c9-b15a-2b831077a3ac/disk.config
Nov 10 21:06:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aa74d6a6-3084-45c9-b15a-2b831077a3ac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpges0v0yl {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aa74d6a6-3084-45c9-b15a-2b831077a3ac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpges0v0yl" returned: 0 in 0.053s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:06:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:19 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:06:19 user nova-compute[75285]: INFO nova.compute.claims [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Claim successful on node user
Nov 10 21:06:20 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG nova.network.neutron [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:06:20 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:06:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG nova.policy [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c0c28be2d29417c90be704cc34848c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e9d9d42834478695c751849a9a8639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:06:20 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Creating image(s)
Nov 10 21:06:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "/opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "/opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.193s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk 1073741824" returned: 0 in 0.055s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG nova.compute.manager [req-97f145f4-bbe9-4d0e-aa9e-61d5fe299c05 req-82a2ec88-401c-4fb3-9a25-35f646063f45 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-a285a3dc-41b1-41f5-8f7f-693f74e288ad {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-97f145f4-bbe9-4d0e-aa9e-61d5fe299c05 req-82a2ec88-401c-4fb3-9a25-35f646063f45 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-97f145f4-bbe9-4d0e-aa9e-61d5fe299c05 req-82a2ec88-401c-4fb3-9a25-35f646063f45 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-97f145f4-bbe9-4d0e-aa9e-61d5fe299c05 req-82a2ec88-401c-4fb3-9a25-35f646063f45 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG nova.compute.manager [req-97f145f4-bbe9-4d0e-aa9e-61d5fe299c05 req-82a2ec88-401c-4fb3-9a25-35f646063f45 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-a285a3dc-41b1-41f5-8f7f-693f74e288ad {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:21 user nova-compute[75285]: WARNING nova.compute.manager [req-97f145f4-bbe9-4d0e-aa9e-61d5fe299c05 req-82a2ec88-401c-4fb3-9a25-35f646063f45 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-a285a3dc-41b1-41f5-8f7f-693f74e288ad for instance with vm_state building and task_state spawning.
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.213s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG nova.network.neutron [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Successfully created port: 53a2c401-3191-4153-94dc-a43a90457023 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Cannot resize image /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Ensure instance console log exists: /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-7df389eb-e0d2-4852-981f-ad3aa35e074f req-c229ea1f-e1a9-4ce6-8703-468c4fba211b service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7df389eb-e0d2-4852-981f-ad3aa35e074f req-c229ea1f-e1a9-4ce6-8703-468c4fba211b service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7df389eb-e0d2-4852-981f-ad3aa35e074f req-c229ea1f-e1a9-4ce6-8703-468c4fba211b service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7df389eb-e0d2-4852-981f-ad3aa35e074f req-c229ea1f-e1a9-4ce6-8703-468c4fba211b service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-7df389eb-e0d2-4852-981f-ad3aa35e074f req-c229ea1f-e1a9-4ce6-8703-468c4fba211b service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:22 user nova-compute[75285]: WARNING nova.compute.manager [req-7df389eb-e0d2-4852-981f-ad3aa35e074f req-c229ea1f-e1a9-4ce6-8703-468c4fba211b service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-99435856-9d26-448e-87de-b0ca7e110d7e for instance with vm_state building and task_state spawning.
Nov 10 21:06:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-d1bfef3a-4189-4030-9bf0-f3268de15a8e req-531a8e33-828d-47c2-b102-3df3a2a310b9 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d1bfef3a-4189-4030-9bf0-f3268de15a8e req-531a8e33-828d-47c2-b102-3df3a2a310b9 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d1bfef3a-4189-4030-9bf0-f3268de15a8e req-531a8e33-828d-47c2-b102-3df3a2a310b9 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d1bfef3a-4189-4030-9bf0-f3268de15a8e req-531a8e33-828d-47c2-b102-3df3a2a310b9 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-d1bfef3a-4189-4030-9bf0-f3268de15a8e req-531a8e33-828d-47c2-b102-3df3a2a310b9 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:22 user nova-compute[75285]: WARNING nova.compute.manager [req-d1bfef3a-4189-4030-9bf0-f3268de15a8e req-531a8e33-828d-47c2-b102-3df3a2a310b9 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d for instance with vm_state building and task_state spawning.
Nov 10 21:06:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG nova.network.neutron [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Successfully updated port: 53a2c401-3191-4153-94dc-a43a90457023 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "refresh_cache-e5fd224c-b34e-41b6-9bdf-28c88579b88c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquired lock "refresh_cache-e5fd224c-b34e-41b6-9bdf-28c88579b88c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG nova.network.neutron [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG nova.network.neutron [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:22 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance ec5dca1b-b623-4a12-af56-aa2bce208869 is timed out.
Nov 10 21:06:22 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Successfully detached device sdc from instance ec5dca1b-b623-4a12-af56-aa2bce208869 from the live domain config.
Nov 10 21:06:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBJvulUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:06:22 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:22 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb35f7e-415d-4d23-9c89-fbecd3950694]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:22 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:06:22 user nova-compute[75285]: No targets found.
Nov 10 21:06:22 user nova-compute[75285]: iSNS:
Nov 10 21:06:22 user nova-compute[75285]: No targets found.
Nov 10 21:06:22 user nova-compute[75285]: STATIC:
Nov 10 21:06:22 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b
Nov 10 21:06:22 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:22 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:22 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d
Nov 10 21:06:22 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:22 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:22 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720
Nov 10 21:06:22 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:22 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:22 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec
Nov 10 21:06:22 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:22 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:22 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85
Nov 10 21:06:22 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:22 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:22 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89
Nov 10 21:06:22 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:22 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:22 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343
Nov 10 21:06:22 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:22 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:22 user nova-compute[75285]: FIRMWARE:
Nov 10 21:06:22 user nova-compute[75285]: No targets found.
Nov 10 21:06:22 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:06:23 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:06:23 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[07729f0f-6efe-4959-84b9-cd3ff4ae3e44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9b78c0-766c-45a2-82fb-40147b49b58f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:23 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:23 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a041d6b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aec0b16-718a-4658-b4b9-1097ca5b506a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe04e59e-1c53-4086-9436-1eed1f206c5c]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ba3ee0-a344-4184-a4ce-a261979270eb]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-a285a3dc-41b1-41f5-8f7f-693f74e288ad {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-a285a3dc-41b1-41f5-8f7f-693f74e288ad {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:23 user nova-compute[75285]: WARNING nova.compute.manager [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-a285a3dc-41b1-41f5-8f7f-693f74e288ad for instance with vm_state building and task_state spawning.
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:23 user nova-compute[75285]: WARNING nova.compute.manager [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf for instance with vm_state building and task_state spawning.
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:23 user nova-compute[75285]: WARNING nova.compute.manager [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf for instance with vm_state building and task_state spawning.
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Received event network-changed-53a2c401-3191-4153-94dc-a43a90457023 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Refreshing instance network info cache due to event network-changed-53a2c401-3191-4153-94dc-a43a90457023. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Acquiring lock "refresh_cache-e5fd224c-b34e-41b6-9bdf-28c88579b88c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0355b87c-422b-4db1-8337-89f9aa50e9ea]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.network.neutron [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Updating instance_info_cache with network_info: [{"id": "53a2c401-3191-4153-94dc-a43a90457023", "address": "fa:16:3e:2a:72:ba", "network": {"id": "84709e26-9628-447a-8a3b-699ba6d9eb33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-411333431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e9d9d42834478695c751849a9a8639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a2c401-31", "ovs_interfaceid": "53a2c401-3191-4153-94dc-a43a90457023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1177f8b-8e99-4ee3-965f-dc924bfc4dee]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Releasing lock "refresh_cache-e5fd224c-b34e-41b6-9bdf-28c88579b88c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.compute.manager [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Instance network_info: |[{"id": "53a2c401-3191-4153-94dc-a43a90457023", "address": "fa:16:3e:2a:72:ba", "network": {"id": "84709e26-9628-447a-8a3b-699ba6d9eb33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-411333431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e9d9d42834478695c751849a9a8639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a2c401-31", "ovs_interfaceid": "53a2c401-3191-4153-94dc-a43a90457023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Acquired lock "refresh_cache-e5fd224c-b34e-41b6-9bdf-28c88579b88c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.network.neutron [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Refreshing network info cache for port 53a2c401-3191-4153-94dc-a43a90457023 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Start _get_guest_xml network_info=[{"id": "53a2c401-3191-4153-94dc-a43a90457023", "address": "fa:16:3e:2a:72:ba", "network": {"id": "84709e26-9628-447a-8a3b-699ba6d9eb33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-411333431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e9d9d42834478695c751849a9a8639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a2c401-31", "ovs_interfaceid": "53a2c401-3191-4153-94dc-a43a90457023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:06:23 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:06:23 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:06:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-596583512',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-596583512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5965835',id=11,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8mj0O7SuFS3Of7voBdcbC9vhOEgp1hnxiHCpWz8pannb/MGmzizQW3SJBl/Q7Ni1kBefsCDcRbw+YaxH7Q29H46+aek6hlPnKO4u5GVtUlIlL5naDhsRg8RLQKPyFB4w==',key_name='tempest-keypair-179669203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e9d9d42834478695c751849a9a8639',ramdisk_id='',reservation_id='r-ou2udife',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1023567829',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c0c28be2d29417c90be704cc34848c0',uuid=e5fd224c-b34e-41b6-9bdf-28c88579b88c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53a2c401-3191-4153-94dc-a43a90457023", "address": "fa:16:3e:2a:72:ba", "network": {"id": "84709e26-9628-447a-8a3b-699ba6d9eb33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-411333431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e9d9d42834478695c751849a9a8639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a2c401-31", "ovs_interfaceid": "53a2c401-3191-4153-94dc-a43a90457023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Converting VIF {"id": "53a2c401-3191-4153-94dc-a43a90457023", "address": "fa:16:3e:2a:72:ba", "network": {"id": "84709e26-9628-447a-8a3b-699ba6d9eb33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-411333431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e9d9d42834478695c751849a9a8639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a2c401-31", "ovs_interfaceid": "53a2c401-3191-4153-94dc-a43a90457023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:72:ba,bridge_name='br-int',has_traffic_filtering=True,id=53a2c401-3191-4153-94dc-a43a90457023,network=Network(84709e26-9628-447a-8a3b-699ba6d9eb33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a2c401-31') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lazy-loading 'pci_devices' on Instance uuid e5fd224c-b34e-41b6-9bdf-28c88579b88c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e1f9c9-f1c7-4327-ad0e-c0a830846e90]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343, portal: 172.16.0.220,3260]
Nov 10 21:06:23 user nova-compute[75285]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343, portal: 172.16.0.220,3260] successful.
Nov 10 21:06:23 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:06:23 user nova-compute[75285]:   <uuid>e5fd224c-b34e-41b6-9bdf-28c88579b88c</uuid>
Nov 10 21:06:23 user nova-compute[75285]:   <name>instance-0000000b</name>
Nov 10 21:06:23 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:06:23 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:06:23 user nova-compute[75285]:   <metadata>
Nov 10 21:06:23 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:06:23 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:06:23 user nova-compute[75285]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-596583512</nova:name>
Nov 10 21:06:23 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:06:23</nova:creationTime>
Nov 10 21:06:23 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:06:23 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:06:23 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:06:23 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:06:23 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:06:23 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:06:23 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:06:23 user nova-compute[75285]:       <nova:owner>
Nov 10 21:06:23 user nova-compute[75285]:         <nova:user uuid="6c0c28be2d29417c90be704cc34848c0">tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member</nova:user>
Nov 10 21:06:23 user nova-compute[75285]:         <nova:project uuid="04e9d9d42834478695c751849a9a8639">tempest-TestServerVolumeAttachScenarioOldVersion-1023567829</nova:project>
Nov 10 21:06:23 user nova-compute[75285]:       </nova:owner>
Nov 10 21:06:23 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:06:23 user nova-compute[75285]:       <nova:ports>
Nov 10 21:06:23 user nova-compute[75285]:         <nova:port uuid="53a2c401-3191-4153-94dc-a43a90457023">
Nov 10 21:06:23 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 21:06:23 user nova-compute[75285]:         </nova:port>
Nov 10 21:06:23 user nova-compute[75285]:       </nova:ports>
Nov 10 21:06:23 user nova-compute[75285]:     </nova:instance>
Nov 10 21:06:23 user nova-compute[75285]:   </metadata>
Nov 10 21:06:23 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:06:23 user nova-compute[75285]:     <system>
Nov 10 21:06:23 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:06:23 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:06:23 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:06:23 user nova-compute[75285]:       <entry name="serial">e5fd224c-b34e-41b6-9bdf-28c88579b88c</entry>
Nov 10 21:06:23 user nova-compute[75285]:       <entry name="uuid">e5fd224c-b34e-41b6-9bdf-28c88579b88c</entry>
Nov 10 21:06:23 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:06:23 user nova-compute[75285]:     </system>
Nov 10 21:06:23 user nova-compute[75285]:   </sysinfo>
Nov 10 21:06:23 user nova-compute[75285]:   <os>
Nov 10 21:06:23 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:06:23 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:06:23 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:06:23 user nova-compute[75285]:   </os>
Nov 10 21:06:23 user nova-compute[75285]:   <features>
Nov 10 21:06:23 user nova-compute[75285]:     <acpi/>
Nov 10 21:06:23 user nova-compute[75285]:     <apic/>
Nov 10 21:06:23 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:06:23 user nova-compute[75285]:   </features>
Nov 10 21:06:23 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:06:23 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:06:23 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:06:23 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:06:23 user nova-compute[75285]:   </clock>
Nov 10 21:06:23 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:06:23 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:06:23 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:06:23 user nova-compute[75285]:   </cpu>
Nov 10 21:06:23 user nova-compute[75285]:   <devices>
Nov 10 21:06:23 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:06:23 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:06:23 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk"/>
Nov 10 21:06:23 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:06:23 user nova-compute[75285]:     </disk>
Nov 10 21:06:23 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:06:23 user nova-compute[75285]:       <mac address="fa:16:3e:2a:72:ba"/>
Nov 10 21:06:23 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:06:23 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:06:23 user nova-compute[75285]:       <target dev="tap53a2c401-31"/>
Nov 10 21:06:23 user nova-compute[75285]:     </interface>
Nov 10 21:06:23 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:06:23 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/console.log" append="off"/>
Nov 10 21:06:23 user nova-compute[75285]:     </serial>
Nov 10 21:06:23 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:06:23 user nova-compute[75285]:     <video>
Nov 10 21:06:23 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:06:23 user nova-compute[75285]:     </video>
Nov 10 21:06:23 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:06:23 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:06:23 user nova-compute[75285]:     </rng>
Nov 10 21:06:23 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:06:23 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:06:23 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:06:23 user nova-compute[75285]:     </memballoon>
Nov 10 21:06:23 user nova-compute[75285]:   </devices>
Nov 10 21:06:23 user nova-compute[75285]: </domain>
Nov 10 21:06:23 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:06:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-596583512',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-596583512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5965835',id=11,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8mj0O7SuFS3Of7voBdcbC9vhOEgp1hnxiHCpWz8pannb/MGmzizQW3SJBl/Q7Ni1kBefsCDcRbw+YaxH7Q29H46+aek6hlPnKO4u5GVtUlIlL5naDhsRg8RLQKPyFB4w==',key_name='tempest-keypair-179669203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e9d9d42834478695c751849a9a8639',ramdisk_id='',reservation_id='r-ou2udife',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1023567829',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c0c28be2d29417c90be704cc34848c0',uuid=e5fd224c-b34e-41b6-9bdf-28c88579b88c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53a2c401-3191-4153-94dc-a43a90457023", "address": "fa:16:3e:2a:72:ba", "network": {"id": "84709e26-9628-447a-8a3b-699ba6d9eb33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-411333431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e9d9d42834478695c751849a9a8639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a2c401-31", "ovs_interfaceid": "53a2c401-3191-4153-94dc-a43a90457023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Converting VIF {"id": "53a2c401-3191-4153-94dc-a43a90457023", "address": "fa:16:3e:2a:72:ba", "network": {"id": "84709e26-9628-447a-8a3b-699ba6d9eb33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-411333431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e9d9d42834478695c751849a9a8639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a2c401-31", "ovs_interfaceid": "53a2c401-3191-4153-94dc-a43a90457023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:72:ba,bridge_name='br-int',has_traffic_filtering=True,id=53a2c401-3191-4153-94dc-a43a90457023,network=Network(84709e26-9628-447a-8a3b-699ba6d9eb33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a2c401-31') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_vif [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:72:ba,bridge_name='br-int',has_traffic_filtering=True,id=53a2c401-3191-4153-94dc-a43a90457023,network=Network(84709e26-9628-447a-8a3b-699ba6d9eb33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a2c401-31') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ace6eab-5db0-5683-ab0f-d4d7e1987389', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64aa237c-d313-4e40-85c0-a3c74ad70343 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55a3762-a04a-476e-af9a-6f1918b66eb9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] <== disconnect_volume: return (444ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53a2c401-31, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53a2c401-31, col_values=(('qos', UUID('a9c43622-c81b-483e-86f9-6bbd15365287')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53a2c401-31, col_values=(('external_ids', {'iface-id': '53a2c401-3191-4153-94dc-a43a90457023', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:72:ba', 'vm-uuid': 'e5fd224c-b34e-41b6-9bdf-28c88579b88c'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:23 user nova-compute[75285]: INFO os_vif [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:72:ba,bridge_name='br-int',has_traffic_filtering=True,id=53a2c401-3191-4153-94dc-a43a90457023,network=Network(84709e26-9628-447a-8a3b-699ba6d9eb33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a2c401-31')
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] No VIF found with MAC fa:16:3e:2a:72:ba, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:06:23 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6db680e7-3e21-4451-a0b1-29f9eca59b2f is timed out.
Nov 10 21:06:23 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Successfully detached device vdb from instance 6db680e7-3e21-4451-a0b1-29f9eca59b2f from the live domain config.
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjnyWUrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:06:23 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95c135c-268e-49c5-a4e4-f1173cb4b9db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:06:23 user nova-compute[75285]: No targets found.
Nov 10 21:06:23 user nova-compute[75285]: iSNS:
Nov 10 21:06:23 user nova-compute[75285]: No targets found.
Nov 10 21:06:23 user nova-compute[75285]: STATIC:
Nov 10 21:06:23 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b
Nov 10 21:06:23 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:23 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:23 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d
Nov 10 21:06:23 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:23 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:23 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720
Nov 10 21:06:23 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:23 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:23 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec
Nov 10 21:06:23 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:23 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:23 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85
Nov 10 21:06:23 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:23 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:23 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89
Nov 10 21:06:23 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:23 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:23 user nova-compute[75285]: FIRMWARE:
Nov 10 21:06:23 user nova-compute[75285]: No targets found.
Nov 10 21:06:23 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:06:23 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:06:23 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef67b1f-63be-4549-b373-bddf7e9c7f14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.network.neutron [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Updated VIF entry in instance network info cache for port 53a2c401-3191-4153-94dc-a43a90457023. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.network.neutron [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Updating instance_info_cache with network_info: [{"id": "53a2c401-3191-4153-94dc-a43a90457023", "address": "fa:16:3e:2a:72:ba", "network": {"id": "84709e26-9628-447a-8a3b-699ba6d9eb33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-411333431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e9d9d42834478695c751849a9a8639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a2c401-31", "ovs_interfaceid": "53a2c401-3191-4153-94dc-a43a90457023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c3ed3c-9347-47f5-8ea7-78ad7cc4efe8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:23 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:23 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:23 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a045fe830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720'): ({'sdc'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Removing single pathed devices sdc {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Releasing lock "refresh_cache-e5fd224c-b34e-41b6-9bdf-28c88579b88c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-875dac5e-5dc7-45f9-befe-a128379298e1 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-875dac5e-5dc7-45f9-befe-a128379298e1 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:23 user nova-compute[75285]: WARNING nova.compute.manager [req-e2aea547-a6ad-4988-8203-5f4c678774f0 req-5958f6e6-46da-4009-ae04-1ce8358e1cc7 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-875dac5e-5dc7-45f9-befe-a128379298e1 for instance with vm_state building and task_state spawning.
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2599bd79-e48d-4a3e-bbae-33f808a1b05c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3303f9-60e5-4543-b7a5-a31732bdf408]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Flushing IO for device /dev/sdc {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f5533e-1745-4cdb-bf8d-9f2989fb22cd]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f60d14c-0301-4de5-887b-62a8d6149132]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce530a3-70b3-4544-b8ed-3c80f99aacaa]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:24 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 431a5e3b-068c-4da3-8198-85b4dcafd266 is timed out.
Nov 10 21:06:24 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Successfully detached device vdb from instance 431a5e3b-068c-4da3-8198-85b4dcafd266 from the live domain config.
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqDvayzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:06:24 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8366cf1a-cb7b-48c8-8817-bce7de4803c3]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720, portal: 172.16.0.220,3260]
Nov 10 21:06:24 user nova-compute[75285]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720, portal: 172.16.0.220,3260] successful.
Nov 10 21:06:24 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6242c82-7d92-4452-a904-81ab911a0720 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9585da71-faa7-49de-815a-ae3e056f85c0]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] <== disconnect_volume: return (373ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.052s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a517d51-4bb3-4fb8-b3db-109c45119260]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:06:24 user nova-compute[75285]: No targets found.
Nov 10 21:06:24 user nova-compute[75285]: iSNS:
Nov 10 21:06:24 user nova-compute[75285]: No targets found.
Nov 10 21:06:24 user nova-compute[75285]: STATIC:
Nov 10 21:06:24 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b
Nov 10 21:06:24 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:24 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:24 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d
Nov 10 21:06:24 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:24 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:24 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec
Nov 10 21:06:24 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:24 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:24 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85
Nov 10 21:06:24 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:24 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:24 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89
Nov 10 21:06:24 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:24 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:24 user nova-compute[75285]: FIRMWARE:
Nov 10 21:06:24 user nova-compute[75285]: No targets found.
Nov 10 21:06:24 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:06:24 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:06:24 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c107c703-ec55-472d-a7c5-bcc77e65ccb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ccc814-dd3b-4f43-8528-a328b909308d]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:24 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:24 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:24 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:24 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:24 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b (non-flash)
Nov 10 21:06:24 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:24 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:24 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:24 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:24 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a045fcca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b'): ({'sdd'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Removing single pathed devices sdd {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65d37b4-0152-46d3-ba04-624aec814b40]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d9a233-9176-4837-bf74-9308ab332197]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Flushing IO for device /dev/sdd {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da3f902-c9a8-4ccf-8091-1ba71289f469]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.029s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d791aa-5aa2-4ba8-a1b1-b9cde6202407]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] SCSI volumes sdd have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7281a2f-4776-45d4-bba6-c2550bfefb10]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf73ccdc-65ec-49ce-ad49-845770222d71]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b, portal: 172.16.0.220,3260]
Nov 10 21:06:24 user nova-compute[75285]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b, portal: 172.16.0.220,3260] successful.
Nov 10 21:06:24 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e77d5094-24a5-4e04-9554-d82a6274d01b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e0ae07-c43e-43ff-9c22-cc41327e9db9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] <== disconnect_volume: return (382ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:24 user nova-compute[75285]: WARNING nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-99435856-9d26-448e-87de-b0ca7e110d7e for instance with vm_state building and task_state spawning.
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-007fd357-2314-47ad-9e02-0e30f5e6dd09 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-007fd357-2314-47ad-9e02-0e30f5e6dd09 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:24 user nova-compute[75285]: WARNING nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-007fd357-2314-47ad-9e02-0e30f5e6dd09 for instance with vm_state building and task_state spawning.
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-007fd357-2314-47ad-9e02-0e30f5e6dd09 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-007fd357-2314-47ad-9e02-0e30f5e6dd09 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:24 user nova-compute[75285]: WARNING nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-007fd357-2314-47ad-9e02-0e30f5e6dd09 for instance with vm_state building and task_state spawning.
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-fb6c95f2-fe2f-488b-8119-6cc8158f90a5 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-fb6c95f2-fe2f-488b-8119-6cc8158f90a5 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:24 user nova-compute[75285]: WARNING nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-fb6c95f2-fe2f-488b-8119-6cc8158f90a5 for instance with vm_state building and task_state spawning.
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-fb6c95f2-fe2f-488b-8119-6cc8158f90a5 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-fb6c95f2-fe2f-488b-8119-6cc8158f90a5 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:24 user nova-compute[75285]: WARNING nova.compute.manager [req-80da28cf-48d8-4c02-8c6a-ddec65718860 req-cc07b177-22b9-44f7-982a-a1372000e0d6 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-fb6c95f2-fe2f-488b-8119-6cc8158f90a5 for instance with vm_state building and task_state spawning.
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-8f7a927c-7738-4b4e-b643-cd8c5ec108f9 req-50f48af1-645e-482f-b27b-2ffa5aeb4cce service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8f7a927c-7738-4b4e-b643-cd8c5ec108f9 req-50f48af1-645e-482f-b27b-2ffa5aeb4cce service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8f7a927c-7738-4b4e-b643-cd8c5ec108f9 req-50f48af1-645e-482f-b27b-2ffa5aeb4cce service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8f7a927c-7738-4b4e-b643-cd8c5ec108f9 req-50f48af1-645e-482f-b27b-2ffa5aeb4cce service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-8f7a927c-7738-4b4e-b643-cd8c5ec108f9 req-50f48af1-645e-482f-b27b-2ffa5aeb4cce service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:24 user nova-compute[75285]: WARNING nova.compute.manager [req-8f7a927c-7738-4b4e-b643-cd8c5ec108f9 req-50f48af1-645e-482f-b27b-2ffa5aeb4cce service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d for instance with vm_state building and task_state spawning.
Nov 10 21:06:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:06:25 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Instance spawned successfully.
Nov 10 21:06:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-c293f4e5-e7e8-46f2-bcc9-e927c24f2d35 req-96460400-01ef-4586-bee1-8acf812a4e6a service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-875dac5e-5dc7-45f9-befe-a128379298e1 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c293f4e5-e7e8-46f2-bcc9-e927c24f2d35 req-96460400-01ef-4586-bee1-8acf812a4e6a service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c293f4e5-e7e8-46f2-bcc9-e927c24f2d35 req-96460400-01ef-4586-bee1-8acf812a4e6a service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c293f4e5-e7e8-46f2-bcc9-e927c24f2d35 req-96460400-01ef-4586-bee1-8acf812a4e6a service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-c293f4e5-e7e8-46f2-bcc9-e927c24f2d35 req-96460400-01ef-4586-bee1-8acf812a4e6a service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-875dac5e-5dc7-45f9-befe-a128379298e1 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:25 user nova-compute[75285]: WARNING nova.compute.manager [req-c293f4e5-e7e8-46f2-bcc9-e927c24f2d35 req-96460400-01ef-4586-bee1-8acf812a4e6a service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-875dac5e-5dc7-45f9-befe-a128379298e1 for instance with vm_state building and task_state spawning.
Nov 10 21:06:25 user nova-compute[75285]: INFO nova.compute.manager [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Took 12.25 seconds to spawn the instance on the hypervisor.
Nov 10 21:06:25 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:06:25 user nova-compute[75285]: INFO nova.compute.manager [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Took 114.93 seconds to build instance.
Nov 10 21:06:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ee94227-061c-40f4-86bf-0ed1fd306c91 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 115.077s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-c3ff2598-8baf-4fe8-a1a4-b77f15e5175b req-06ec7a62-32c7-420d-a4dd-9a4d1096788b service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Received event network-vif-plugged-53a2c401-3191-4153-94dc-a43a90457023 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c3ff2598-8baf-4fe8-a1a4-b77f15e5175b req-06ec7a62-32c7-420d-a4dd-9a4d1096788b service nova] Acquiring lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c3ff2598-8baf-4fe8-a1a4-b77f15e5175b req-06ec7a62-32c7-420d-a4dd-9a4d1096788b service nova] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c3ff2598-8baf-4fe8-a1a4-b77f15e5175b req-06ec7a62-32c7-420d-a4dd-9a4d1096788b service nova] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-c3ff2598-8baf-4fe8-a1a4-b77f15e5175b req-06ec7a62-32c7-420d-a4dd-9a4d1096788b service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] No waiting events found dispatching network-vif-plugged-53a2c401-3191-4153-94dc-a43a90457023 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:26 user nova-compute[75285]: WARNING nova.compute.manager [req-c3ff2598-8baf-4fe8-a1a4-b77f15e5175b req-06ec7a62-32c7-420d-a4dd-9a4d1096788b service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Received unexpected event network-vif-plugged-53a2c401-3191-4153-94dc-a43a90457023 for instance with vm_state building and task_state spawning.
Nov 10 21:06:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-c3ff2598-8baf-4fe8-a1a4-b77f15e5175b req-06ec7a62-32c7-420d-a4dd-9a4d1096788b service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Received event network-vif-plugged-53a2c401-3191-4153-94dc-a43a90457023 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c3ff2598-8baf-4fe8-a1a4-b77f15e5175b req-06ec7a62-32c7-420d-a4dd-9a4d1096788b service nova] Acquiring lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c3ff2598-8baf-4fe8-a1a4-b77f15e5175b req-06ec7a62-32c7-420d-a4dd-9a4d1096788b service nova] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c3ff2598-8baf-4fe8-a1a4-b77f15e5175b req-06ec7a62-32c7-420d-a4dd-9a4d1096788b service nova] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-c3ff2598-8baf-4fe8-a1a4-b77f15e5175b req-06ec7a62-32c7-420d-a4dd-9a4d1096788b service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] No waiting events found dispatching network-vif-plugged-53a2c401-3191-4153-94dc-a43a90457023 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:26 user nova-compute[75285]: WARNING nova.compute.manager [req-c3ff2598-8baf-4fe8-a1a4-b77f15e5175b req-06ec7a62-32c7-420d-a4dd-9a4d1096788b service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Received unexpected event network-vif-plugged-53a2c401-3191-4153-94dc-a43a90457023 for instance with vm_state building and task_state spawning.
Nov 10 21:06:27 user nova-compute[75285]: DEBUG nova.compute.manager [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:06:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:06:27 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Instance spawned successfully.
Nov 10 21:06:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:06:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:06:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:06:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:06:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:06:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:06:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:06:27 user nova-compute[75285]: INFO nova.compute.manager [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 10 21:06:27 user nova-compute[75285]: DEBUG nova.compute.manager [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:06:27 user nova-compute[75285]: INFO nova.compute.manager [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Took 7.80 seconds to build instance.
Nov 10 21:06:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3e876e54-4b2c-4962-a10f-da1729e00cd9 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.933s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kdImCpuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:06:32 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:32 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:32 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffaf3eb-6936-4236-9be0-9a87fa59df52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:06:32 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[004cb5db-0519-45de-b526-0fbb528d3a18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1] added
Nov 10 21:06:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e202f8-ff48-4e7f-b97d-d985cc7add5a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ec74bf-3e29-4e7d-a72e-0e68741e9f1d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kdImCpuN {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kdImCpuN" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e13548-e59c-44f1-9fb5-1f6898fde2cc]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kdImCpuN'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f1c4df-c9c6-4c12-96fc-779668ea90f2]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc5ec88-c41d-484a-9345-c02b3dd3f56a]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:32 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:32 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:32 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:32 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:32 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:32 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab030601-7e9d-4acb-8b64-a2c82c5bdbd7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1, portal: 172.16.0.220,3260]
Nov 10 21:06:32 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1, portal: 172.16.0.220,3260] successful.
Nov 10 21:06:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[171f5b8f-36c0-40d6-8bbd-06a3a66522b9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c340dd7e-216b-429d-b156-c3896f26e311]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:32 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:32 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:32 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:32 user nova-compute[75285]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)
Nov 10 21:06:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:32 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:32 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:32 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:32 user nova-compute[75285]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)
Nov 10 21:06:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4779cb-c326-47e8-9a71-15f16db4fe67]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:06:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kdImCpuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:06:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23365376331646662', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365376331646662', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:06:33 user nova-compute[75285]: DEBUG nova.objects.instance [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lazy-loading 'flavor' on Instance uuid 82a83f12-0822-4cd0-8d1b-3f939a601745 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:33 user nova-compute[75285]: DEBUG nova.objects.instance [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lazy-loading 'flavor' on Instance uuid ec5dca1b-b623-4a12-af56-aa2bce208869 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:33 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:06:33 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:06:33 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:06:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] attach device xml: <disk type="block" device="disk">
Nov 10 21:06:33 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:06:33 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:06:33 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:06:33 user nova-compute[75285]:   <serial>2a5ace56-4ec9-4554-bccf-5fc57cf44fd1</serial>
Nov 10 21:06:33 user nova-compute[75285]: </disk>
Nov 10 21:06:33 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:06:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cdde43bf-21c6-4f53-8db5-4de8c1ae8229 tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.869s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:06:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:06:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] No VIF found with MAC fa:16:3e:44:22:16, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:06:34 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lazy-loading 'flavor' on Instance uuid 6db680e7-3e21-4451-a0b1-29f9eca59b2f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:34 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:06:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b257d79-f63e-4e4b-a973-e4dabf8a9d7d tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.704s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:35 user nova-compute[75285]: DEBUG nova.objects.instance [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lazy-loading 'flavor' on Instance uuid 431a5e3b-068c-4da3-8198-85b4dcafd266 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9abb0703-f42f-4d93-98ad-13095c331935 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.546s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.compute.manager [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnrThtWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f6ad802-6f8f-42bc-95bd-934f4c9f55c3', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd', 'serial': 'e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZdEGvyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '8f6ad802-6f8f-42bc-95bd-934f4c9f55c3', 'attached_at': '', 'detached_at': '', 'volume_id': '7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 'serial'} {{(pid=75285) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnrThtWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:06:36 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:36 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:36 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c606603-d9a8-4534-9933-448bbdb29ba2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:06:36 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3acfb12-6c0d-4f08-96ea-9c06f574c0e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd] added
Nov 10 21:06:36 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baec9f6-8b9a-4938-9561-059b001ac0b9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "interface-431a5e3b-068c-4da3-8198-85b4dcafd266-8f2bb0e5-40d2-4044-b859-039ea6160907" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "interface-431a5e3b-068c-4da3-8198-85b4dcafd266-8f2bb0e5-40d2-4044-b859-039ea6160907" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.volume.cinder [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Update attachment failed for attachment dbdc84df-5dda-4c53-aa48-27b8ddf82b3c. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5673ad66-19d0-4db3-b6f3-1bb82743bdcb) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5673ad66-19d0-4db3-b6f3-1bb82743bdcb)
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fde79d7-f5e2-4676-a2d2-f78a9e5c895b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lnrThtWs {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.objects.instance [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lazy-loading 'flavor' on Instance uuid 431a5e3b-068c-4da3-8198-85b4dcafd266 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Failed to attach a10c02ba-99bb-4c32-bef2-90c1d9ef1272 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5673ad66-19d0-4db3-b6f3-1bb82743bdcb)
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Traceback (most recent call last):
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     self._do_attach(context, instance, volume, volume_api,
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     self._volume_attach(context, volume, connector, instance,
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     connection_info = volume_api.attachment_update(
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     res = method(self, ctx, *args, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     with excutils.save_and_reraise_exception():
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     self.force_reraise()
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     raise self.value
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     return method.func(obj, *args, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     resp = self._update('/attachments/%s' % id, body)
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     return self.request(url, method, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f]     raise exceptions.from_response(resp, body)
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5673ad66-19d0-4db3-b6f3-1bb82743bdcb)
Nov 10 21:06:36 user nova-compute[75285]: ERROR nova.compute.manager [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] 
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lnrThtWs" returned: 0 in 0.032s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cf89e2-0a0d-4975-acf2-ff7704217a9f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lnrThtWs'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1188264763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1188264763',id=6,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJVDaV9K6SBR1XEp4BdAS6FdSHtLIn40w3r0dF5WwWJ6G68NbKximpSS6o3RxdgTS65FI2WOslaptWqshVaLeSVBsAD2z4r2afuysf1qmQl+94ffn2lCbbP+vU1cmDehA==',key_name='tempest-keypair-1028305531',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:03:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96cc434b2e3e46c3998436f1c6ae971a',ramdisk_id='',reservation_id='r-dswcb0qh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-941419187',owner_user_name='tempest-TaggedAttachmentsTest-941419187-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f018af822634a0b8b9902c811637795',uuid=431a5e3b-068c-4da3-8198-85b4dcafd266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f2bb0e5-40d2-4044-b859-039ea6160907", "address": "fa:16:3e:c2:90:32", "network": {"id": "44f55482-2ba6-4d93-ad7b-18394f52c1e2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1576076603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2bb0e5-40", "ovs_interfaceid": "8f2bb0e5-40d2-4044-b859-039ea6160907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Converting VIF {"id": "8f2bb0e5-40d2-4044-b859-039ea6160907", "address": "fa:16:3e:c2:90:32", "network": {"id": "44f55482-2ba6-4d93-ad7b-18394f52c1e2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1576076603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2bb0e5-40", "ovs_interfaceid": "8f2bb0e5-40d2-4044-b859-039ea6160907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:90:32,bridge_name='br-int',has_traffic_filtering=True,id=8f2bb0e5-40d2-4044-b859-039ea6160907,network=Network(44f55482-2ba6-4d93-ad7b-18394f52c1e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2bb0e5-40') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:90:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f2bb0e5-40"/></interface> {{(pid=75285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:90:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f2bb0e5-40"/></interface> {{(pid=75285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b6af38-60a3-460c-9abd-b57f957df6da]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Attempting to detach device tap8f2bb0e5-40 from instance 431a5e3b-068c-4da3-8198-85b4dcafd266 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] detach device xml: <interface type="ethernet">
Nov 10 21:06:36 user nova-compute[75285]:   <mac address="fa:16:3e:c2:90:32"/>
Nov 10 21:06:36 user nova-compute[75285]:   <model type="virtio"/>
Nov 10 21:06:36 user nova-compute[75285]:   <mtu size="1442"/>
Nov 10 21:06:36 user nova-compute[75285]:   <target dev="tap8f2bb0e5-40"/>
Nov 10 21:06:36 user nova-compute[75285]: </interface>
Nov 10 21:06:36 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:90:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f2bb0e5-40"/></interface> {{(pid=75285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c2:90:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f2bb0e5-40"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 10 21:06:36 user nova-compute[75285]:   <name>instance-00000006</name>
Nov 10 21:06:36 user nova-compute[75285]:   <uuid>431a5e3b-068c-4da3-8198-85b4dcafd266</uuid>
Nov 10 21:06:36 user nova-compute[75285]:   <metadata>
Nov 10 21:06:36 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:06:36 user nova-compute[75285]:   <nova:package version="0.0.0"/>
Nov 10 21:06:36 user nova-compute[75285]:   <nova:name>tempest-device-tagging-server-1188264763</nova:name>
Nov 10 21:06:36 user nova-compute[75285]:   <nova:creationTime>2023-11-10 21:05:08</nova:creationTime>
Nov 10 21:06:36 user nova-compute[75285]:   <nova:flavor name="m1.tiny">
Nov 10 21:06:36 user nova-compute[75285]:     <nova:memory>512</nova:memory>
Nov 10 21:06:36 user nova-compute[75285]:     <nova:disk>1</nova:disk>
Nov 10 21:06:36 user nova-compute[75285]:     <nova:swap>0</nova:swap>
Nov 10 21:06:36 user nova-compute[75285]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:06:36 user nova-compute[75285]:     <nova:vcpus>1</nova:vcpus>
Nov 10 21:06:36 user nova-compute[75285]:   </nova:flavor>
Nov 10 21:06:36 user nova-compute[75285]:   <nova:owner>
Nov 10 21:06:36 user nova-compute[75285]:     <nova:user uuid="0f018af822634a0b8b9902c811637795">tempest-TaggedAttachmentsTest-941419187-project-member</nova:user>
Nov 10 21:06:36 user nova-compute[75285]:     <nova:project uuid="96cc434b2e3e46c3998436f1c6ae971a">tempest-TaggedAttachmentsTest-941419187</nova:project>
Nov 10 21:06:36 user nova-compute[75285]:   </nova:owner>
Nov 10 21:06:36 user nova-compute[75285]:   <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:06:36 user nova-compute[75285]:   <nova:ports>
Nov 10 21:06:36 user nova-compute[75285]:     <nova:port uuid="46353ed3-1736-493a-99b8-580504a9abc9">
Nov 10 21:06:36 user nova-compute[75285]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 21:06:36 user nova-compute[75285]:     </nova:port>
Nov 10 21:06:36 user nova-compute[75285]:     <nova:port uuid="8f2bb0e5-40d2-4044-b859-039ea6160907">
Nov 10 21:06:36 user nova-compute[75285]:       <nova:ip type="fixed" address="10.10.10.69" ipVersion="4"/>
Nov 10 21:06:36 user nova-compute[75285]:     </nova:port>
Nov 10 21:06:36 user nova-compute[75285]:   </nova:ports>
Nov 10 21:06:36 user nova-compute[75285]: </nova:instance>
Nov 10 21:06:36 user nova-compute[75285]:   </metadata>
Nov 10 21:06:36 user nova-compute[75285]:   <memory unit='KiB'>524288</memory>
Nov 10 21:06:36 user nova-compute[75285]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 21:06:36 user nova-compute[75285]:   <vcpu placement='static'>1</vcpu>
Nov 10 21:06:36 user nova-compute[75285]:   <resource>
Nov 10 21:06:36 user nova-compute[75285]:     <partition>/machine</partition>
Nov 10 21:06:36 user nova-compute[75285]:   </resource>
Nov 10 21:06:36 user nova-compute[75285]:   <sysinfo type='smbios'>
Nov 10 21:06:36 user nova-compute[75285]:     <system>
Nov 10 21:06:36 user nova-compute[75285]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 21:06:36 user nova-compute[75285]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 21:06:36 user nova-compute[75285]:       <entry name='version'>0.0.0</entry>
Nov 10 21:06:36 user nova-compute[75285]:       <entry name='serial'>431a5e3b-068c-4da3-8198-85b4dcafd266</entry>
Nov 10 21:06:36 user nova-compute[75285]:       <entry name='uuid'>431a5e3b-068c-4da3-8198-85b4dcafd266</entry>
Nov 10 21:06:36 user nova-compute[75285]:       <entry name='family'>Virtual Machine</entry>
Nov 10 21:06:36 user nova-compute[75285]:     </system>
Nov 10 21:06:36 user nova-compute[75285]:   </sysinfo>
Nov 10 21:06:36 user nova-compute[75285]:   <os>
Nov 10 21:06:36 user nova-compute[75285]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 21:06:36 user nova-compute[75285]:     <boot dev='hd'/>
Nov 10 21:06:36 user nova-compute[75285]:     <smbios mode='sysinfo'/>
Nov 10 21:06:36 user nova-compute[75285]:   </os>
Nov 10 21:06:36 user nova-compute[75285]:   <features>
Nov 10 21:06:36 user nova-compute[75285]:     <acpi/>
Nov 10 21:06:36 user nova-compute[75285]:     <apic/>
Nov 10 21:06:36 user nova-compute[75285]:     <vmcoreinfo state='on'/>
Nov 10 21:06:36 user nova-compute[75285]:   </features>
Nov 10 21:06:36 user nova-compute[75285]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 21:06:36 user nova-compute[75285]:     <model fallback='forbid'>Nehalem</model>
Nov 10 21:06:36 user nova-compute[75285]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 21:06:36 user nova-compute[75285]:     <feature policy='require' name='vme'/>
Nov 10 21:06:36 user nova-compute[75285]:     <feature policy='require' name='x2apic'/>
Nov 10 21:06:36 user nova-compute[75285]:     <feature policy='require' name='hypervisor'/>
Nov 10 21:06:36 user nova-compute[75285]:   </cpu>
Nov 10 21:06:36 user nova-compute[75285]:   <clock offset='utc'>
Nov 10 21:06:36 user nova-compute[75285]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 21:06:36 user nova-compute[75285]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 21:06:36 user nova-compute[75285]:     <timer name='hpet' present='no'/>
Nov 10 21:06:36 user nova-compute[75285]:   </clock>
Nov 10 21:06:36 user nova-compute[75285]:   <on_poweroff>destroy</on_poweroff>
Nov 10 21:06:36 user nova-compute[75285]:   <on_reboot>restart</on_reboot>
Nov 10 21:06:36 user nova-compute[75285]:   <on_crash>destroy</on_crash>
Nov 10 21:06:36 user nova-compute[75285]:   <devices>
Nov 10 21:06:36 user nova-compute[75285]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 21:06:36 user nova-compute[75285]:     <disk type='file' device='disk'>
Nov 10 21:06:36 user nova-compute[75285]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 21:06:36 user nova-compute[75285]:       <source file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk' index='2'/>
Nov 10 21:06:36 user nova-compute[75285]:       <backingStore type='file' index='3'>
Nov 10 21:06:36 user nova-compute[75285]:         <format type='raw'/>
Nov 10 21:06:36 user nova-compute[75285]:         <source file='/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1'/>
Nov 10 21:06:36 user nova-compute[75285]:         <backingStore/>
Nov 10 21:06:36 user nova-compute[75285]:       </backingStore>
Nov 10 21:06:36 user nova-compute[75285]:       <target dev='vda' bus='virtio'/>
Nov 10 21:06:36 user nova-compute[75285]:       <alias name='virtio-disk0'/>
Nov 10 21:06:36 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 21:06:36 user nova-compute[75285]:     </disk>
Nov 10 21:06:36 user nova-compute[75285]:     <disk type='file' device='cdrom'>
Nov 10 21:06:36 user nova-compute[75285]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 21:06:36 user nova-compute[75285]:       <source file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk.config' index='1'/>
Nov 10 21:06:36 user nova-compute[75285]:       <backingStore/>
Nov 10 21:06:36 user nova-compute[75285]:       <target dev='hda' bus='ide'/>
Nov 10 21:06:36 user nova-compute[75285]:       <readonly/>
Nov 10 21:06:36 user nova-compute[75285]:       <alias name='ide0-0-0'/>
Nov 10 21:06:36 user nova-compute[75285]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 21:06:36 user nova-compute[75285]:     </disk>
Nov 10 21:06:36 user nova-compute[75285]:     <controller type='usb' index='0' model='none'>
Nov 10 21:06:36 user nova-compute[75285]:       <alias name='usb'/>
Nov 10 21:06:36 user nova-compute[75285]:     </controller>
Nov 10 21:06:36 user nova-compute[75285]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 21:06:36 user nova-compute[75285]:       <alias name='pci.0'/>
Nov 10 21:06:36 user nova-compute[75285]:     </controller>
Nov 10 21:06:36 user nova-compute[75285]:     <controller type='ide' index='0'>
Nov 10 21:06:36 user nova-compute[75285]:       <alias name='ide'/>
Nov 10 21:06:36 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 21:06:36 user nova-compute[75285]:     </controller>
Nov 10 21:06:36 user nova-compute[75285]:     <interface type='ethernet'>
Nov 10 21:06:36 user nova-compute[75285]:       <mac address='fa:16:3e:06:22:3a'/>
Nov 10 21:06:36 user nova-compute[75285]:       <target dev='tap46353ed3-17'/>
Nov 10 21:06:36 user nova-compute[75285]:       <model type='virtio'/>
Nov 10 21:06:36 user nova-compute[75285]:       <mtu size='1442'/>
Nov 10 21:06:36 user nova-compute[75285]:       <alias name='net0'/>
Nov 10 21:06:36 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 21:06:36 user nova-compute[75285]:     </interface>
Nov 10 21:06:36 user nova-compute[75285]:     <interface type='ethernet'>
Nov 10 21:06:36 user nova-compute[75285]:       <mac address='fa:16:3e:c2:90:32'/>
Nov 10 21:06:36 user nova-compute[75285]:       <target dev='tap8f2bb0e5-40'/>
Nov 10 21:06:36 user nova-compute[75285]:       <model type='virtio'/>
Nov 10 21:06:36 user nova-compute[75285]:       <mtu size='1442'/>
Nov 10 21:06:36 user nova-compute[75285]:       <alias name='net1'/>
Nov 10 21:06:36 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 10 21:06:36 user nova-compute[75285]:     </interface>
Nov 10 21:06:36 user nova-compute[75285]:     <serial type='pty'>
Nov 10 21:06:36 user nova-compute[75285]:       <source path='/dev/pts/5'/>
Nov 10 21:06:36 user nova-compute[75285]:       <log file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/console.log' append='off'/>
Nov 10 21:06:36 user nova-compute[75285]:       <target type='isa-serial' port='0'>
Nov 10 21:06:36 user nova-compute[75285]:         <model name='isa-serial'/>
Nov 10 21:06:36 user nova-compute[75285]:       </target>
Nov 10 21:06:36 user nova-compute[75285]:       <alias name='serial0'/>
Nov 10 21:06:36 user nova-compute[75285]:     </serial>
Nov 10 21:06:36 user nova-compute[75285]:     <console type='pty' tty='/dev/pts/5'>
Nov 10 21:06:36 user nova-compute[75285]:       <source path='/dev/pts/5'/>
Nov 10 21:06:36 user nova-compute[75285]:       <log file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/console.log' append='off'/>
Nov 10 21:06:36 user nova-compute[75285]:       <target type='serial' port='0'/>
Nov 10 21:06:36 user nova-compute[75285]:       <alias name='serial0'/>
Nov 10 21:06:36 user nova-compute[75285]:     </console>
Nov 10 21:06:36 user nova-compute[75285]:     <input type='mouse' bus='ps2'>
Nov 10 21:06:36 user nova-compute[75285]:       <alias name='input0'/>
Nov 10 21:06:36 user nova-compute[75285]:     </input>
Nov 10 21:06:36 user nova-compute[75285]:     <input type='keyboard' bus='ps2'>
Nov 10 21:06:36 user nova-compute[75285]:       <alias name='input1'/>
Nov 10 21:06:36 user nova-compute[75285]:     </input>
Nov 10 21:06:36 user nova-compute[75285]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 10 21:06:36 user nova-compute[75285]:       <listen type='address' address='0.0.0.0'/>
Nov 10 21:06:36 user nova-compute[75285]:     </graphics>
Nov 10 21:06:36 user nova-compute[75285]:     <audio id='1' type='none'/>
Nov 10 21:06:36 user nova-compute[75285]:     <video>
Nov 10 21:06:36 user nova-compute[75285]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 21:06:36 user nova-compute[75285]:       <alias name='video0'/>
Nov 10 21:06:36 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 21:06:36 user nova-compute[75285]:     </video>
Nov 10 21:06:36 user nova-compute[75285]:     <memballoon model='virtio'>
Nov 10 21:06:36 user nova-compute[75285]:       <stats period='10'/>
Nov 10 21:06:36 user nova-compute[75285]:       <alias name='balloon0'/>
Nov 10 21:06:36 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 21:06:36 user nova-compute[75285]:     </memballoon>
Nov 10 21:06:36 user nova-compute[75285]:     <rng model='virtio'>
Nov 10 21:06:36 user nova-compute[75285]:       <backend model='random'>/dev/urandom</backend>
Nov 10 21:06:36 user nova-compute[75285]:       <alias name='rng0'/>
Nov 10 21:06:36 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 21:06:36 user nova-compute[75285]:     </rng>
Nov 10 21:06:36 user nova-compute[75285]:   </devices>
Nov 10 21:06:36 user nova-compute[75285]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 21:06:36 user nova-compute[75285]:     <label>libvirt-431a5e3b-068c-4da3-8198-85b4dcafd266</label>
Nov 10 21:06:36 user nova-compute[75285]:     <imagelabel>libvirt-431a5e3b-068c-4da3-8198-85b4dcafd266</imagelabel>
Nov 10 21:06:36 user nova-compute[75285]:   </seclabel>
Nov 10 21:06:36 user nova-compute[75285]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 21:06:36 user nova-compute[75285]:     <label>+64055:+108</label>
Nov 10 21:06:36 user nova-compute[75285]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 21:06:36 user nova-compute[75285]:   </seclabel>
Nov 10 21:06:36 user nova-compute[75285]: </domain>
Nov 10 21:06:36 user nova-compute[75285]:  {{(pid=75285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 21:06:36 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Successfully detached device tap8f2bb0e5-40 from instance 431a5e3b-068c-4da3-8198-85b4dcafd266 from the persistent domain config.
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] (1/8): Attempting to detach device tap8f2bb0e5-40 with device alias net1 from instance 431a5e3b-068c-4da3-8198-85b4dcafd266 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] detach device xml: <interface type="ethernet">
Nov 10 21:06:36 user nova-compute[75285]:   <mac address="fa:16:3e:c2:90:32"/>
Nov 10 21:06:36 user nova-compute[75285]:   <model type="virtio"/>
Nov 10 21:06:36 user nova-compute[75285]:   <mtu size="1442"/>
Nov 10 21:06:36 user nova-compute[75285]:   <target dev="tap8f2bb0e5-40"/>
Nov 10 21:06:36 user nova-compute[75285]: </interface>
Nov 10 21:06:36 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d9ecc5-3482-4d9c-851c-0c75b0228295]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)
Nov 10 21:06:36 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)
Nov 10 21:06:36 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.982s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f067be4e-118e-438e-a940-835feb13b2ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd, portal: 172.16.0.220,3260]
Nov 10 21:06:36 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd, portal: 172.16.0.220,3260] successful.
Nov 10 21:06:36 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c8d056-ddfc-4e73-983e-5a4183568939]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server [None req-2007043e-9fd0-43ed-bc6e-d618816bfbf4 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5673ad66-19d0-4db3-b6f3-1bb82743bdcb)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5673ad66-19d0-4db3-b6f3-1bb82743bdcb)
Nov 10 21:06:36 user nova-compute[75285]: ERROR oslo_messaging.rpc.server 
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3960c867-5650-40e7-8387-269312242019]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)
Nov 10 21:06:36 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:36 user nova-compute[75285]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)
Nov 10 21:06:36 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.443s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11d1e22-0525-49da-a0d1-3369bd091c4f]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Start waiting for the detach event from libvirt for device tap8f2bb0e5-40 with device alias net1 for instance 431a5e3b-068c-4da3-8198-85b4dcafd266 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "ec5dca1b-b623-4a12-af56-aa2bce208869" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:36 user nova-compute[75285]: INFO nova.compute.manager [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Terminating instance
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.compute.manager [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5ebe014d-946a-4163-a5b6-f60bf3ad143f tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 66.478s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-9b104abd-8436-4d04-843d-2293806f263b req-09d9c8cd-daf7-4284-be42-2398114ba1d6 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received event network-vif-unplugged-8f2bb0e5-40d2-4044-b859-039ea6160907 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9b104abd-8436-4d04-843d-2293806f263b req-09d9c8cd-daf7-4284-be42-2398114ba1d6 service nova] Acquiring lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9b104abd-8436-4d04-843d-2293806f263b req-09d9c8cd-daf7-4284-be42-2398114ba1d6 service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9b104abd-8436-4d04-843d-2293806f263b req-09d9c8cd-daf7-4284-be42-2398114ba1d6 service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-9b104abd-8436-4d04-843d-2293806f263b req-09d9c8cd-daf7-4284-be42-2398114ba1d6 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] No waiting events found dispatching network-vif-unplugged-8f2bb0e5-40d2-4044-b859-039ea6160907 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:36 user nova-compute[75285]: WARNING nova.compute.manager [req-9b104abd-8436-4d04-843d-2293806f263b req-09d9c8cd-daf7-4284-be42-2398114ba1d6 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received unexpected event network-vif-unplugged-8f2bb0e5-40d2-4044-b859-039ea6160907 for instance with vm_state active and task_state None.
Nov 10 21:06:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-63c676c7-3692-4ed0-b43d-6f6c843e4ee1 tempest-VolumesAssistedSnapshotsTest-1844356727 tempest-VolumesAssistedSnapshotsTest-1844356727-project] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] volume_snapshot_create: create_info: {'snapshot_id': '7150230e-d0c5-4ad6-9a28-3aee8f0e57f8', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75285) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-63c676c7-3692-4ed0-b43d-6f6c843e4ee1 tempest-VolumesAssistedSnapshotsTest-1844356727 tempest-VolumesAssistedSnapshotsTest-1844356727-project] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] snap xml: <domainsnapshot>
Nov 10 21:06:37 user nova-compute[75285]:   <disks>
Nov 10 21:06:37 user nova-compute[75285]:     <disk name="/dev/sdb" snapshot="external" type="file">
Nov 10 21:06:37 user nova-compute[75285]:       <source file="/dev/new_file"/>
Nov 10 21:06:37 user nova-compute[75285]:     </disk>
Nov 10 21:06:37 user nova-compute[75285]:     <disk name="vda" snapshot="no"/>
Nov 10 21:06:37 user nova-compute[75285]:   </disks>
Nov 10 21:06:37 user nova-compute[75285]: </domainsnapshot>
Nov 10 21:06:37 user nova-compute[75285]:  {{(pid=75285) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.objects.instance [None req-63c676c7-3692-4ed0-b43d-6f6c843e4ee1 tempest-VolumesAssistedSnapshotsTest-1844356727 tempest-VolumesAssistedSnapshotsTest-1844356727-project] Lazy-loading 'system_metadata' on Instance uuid 82a83f12-0822-4cd0-8d1b-3f939a601745 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-63c676c7-3692-4ed0-b43d-6f6c843e4ee1 tempest-VolumesAssistedSnapshotsTest-1844356727 tempest-VolumesAssistedSnapshotsTest-1844356727-project] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 21:06:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Instance destroyed successfully.
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.objects.instance [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lazy-loading 'resources' on Instance uuid ec5dca1b-b623-4a12-af56-aa2bce208869 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [None req-63c676c7-3692-4ed0-b43d-6f6c843e4ee1 tempest-VolumesAssistedSnapshotsTest-1844356727 tempest-VolumesAssistedSnapshotsTest-1844356727-project] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Traceback (most recent call last):
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     rv = execute(f, *args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     six.reraise(c, e, tb)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     raise value
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     rv = meth(*args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] 
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [None req-63c676c7-3692-4ed0-b43d-6f6c843e4ee1 tempest-VolumesAssistedSnapshotsTest-1844356727 tempest-VolumesAssistedSnapshotsTest-1844356727-project] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Traceback (most recent call last):
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     self._volume_snapshot_create(context, instance, guest,
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     rv = execute(f, *args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     six.reraise(c, e, tb)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     raise value
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     rv = meth(*args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] 
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1494260737',display_name='tempest-AttachSCSIVolumeTestJSON-server-1494260737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1494260737',id=5,image_ref='5d30289a-3cd5-4718-9ea9-b7c22634f03a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQXbzJQJ9OTkEJhGd9LF6nEvURELc2jbg5QFrJPwkL7j7Zu84R7K8F14+/zWXNYdfK6kdK0F687pvjtZgtL1FNETSXMDHWeldRMR0FJN8goWiPI21YE4dOcR4E++TlGzw==',key_name='tempest-keypair-109077833',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:03:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ceffccaaef04b4ebb2fc39daf3a66ae',ramdisk_id='',reservation_id='r-xokoq71b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d30289a-3cd5-4718-9ea9-b7c22634f03a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1853623146',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1853623146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc503491280b4db7a8dc3b1cd866dedb',uuid=ec5dca1b-b623-4a12-af56-aa2bce208869,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "address": "fa:16:3e:79:58:f8", "network": {"id": "35b31ce0-80bb-48f2-a9dd-1c30acbca7e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1234893326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ceffccaaef04b4ebb2fc39daf3a66ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9179b028-23", "ovs_interfaceid": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Converting VIF {"id": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "address": "fa:16:3e:79:58:f8", "network": {"id": "35b31ce0-80bb-48f2-a9dd-1c30acbca7e2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1234893326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ceffccaaef04b4ebb2fc39daf3a66ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9179b028-23", "ovs_interfaceid": "9179b028-23d4-4b6e-bac0-9df516cc9dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:58:f8,bridge_name='br-int',has_traffic_filtering=True,id=9179b028-23d4-4b6e-bac0-9df516cc9dfe,network=Network(35b31ce0-80bb-48f2-a9dd-1c30acbca7e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9179b028-23') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG os_vif [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:58:f8,bridge_name='br-int',has_traffic_filtering=True,id=9179b028-23d4-4b6e-bac0-9df516cc9dfe,network=Network(35b31ce0-80bb-48f2-a9dd-1c30acbca7e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9179b028-23') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnrThtWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.518s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] <== connect_volume: return (1520ms) {'type': 'block', 'scsi_wwn': '26632333038353565', 'path': '/dev/sdc'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632333038353565', 'path': '/dev/sdc'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3906a571-3342-4fbf-9bce-1fc7c8bc23a5 tempest-VolumesAssistedSnapshotsTest-1844356727 tempest-VolumesAssistedSnapshotsTest-1844356727-project] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] volume_snapshot_delete: delete_info: {'volume_id': '2a5ace56-4ec9-4554-bccf-5fc57cf44fd1'} {{(pid=75285) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [None req-3906a571-3342-4fbf-9bce-1fc7c8bc23a5 tempest-VolumesAssistedSnapshotsTest-1844356727 tempest-VolumesAssistedSnapshotsTest-1844356727-project] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Traceback (most recent call last):
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745]     if delete_info['type'] != 'qcow2':
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] KeyError: 'type'
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] 
Nov 10 21:06:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9179b028-23, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3d407e6-b89c-48e6-a1ae-deeda001ac2e) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [None req-63c676c7-3692-4ed0-b43d-6f6c843e4ee1 tempest-VolumesAssistedSnapshotsTest-1844356727 tempest-VolumesAssistedSnapshotsTest-1844356727-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 7150230e-d0c5-4ad6-9a28-3aee8f0e57f8 could not be found.
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     raise value
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver 
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver 
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 7150230e-d0c5-4ad6-9a28-3aee8f0e57f8 could not be found. (HTTP 404) (Request-ID: req-0b881a0e-943d-498d-b11e-3065b6ef142d)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver 
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver 
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 7150230e-d0c5-4ad6-9a28-3aee8f0e57f8 could not be found.
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver 
Nov 10 21:06:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.objects.instance [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lazy-loading 'flavor' on Instance uuid 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server [None req-63c676c7-3692-4ed0-b43d-6f6c843e4ee1 tempest-VolumesAssistedSnapshotsTest-1844356727 tempest-VolumesAssistedSnapshotsTest-1844356727-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise value
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server 
Nov 10 21:06:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:37 user nova-compute[75285]: INFO os_vif [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:58:f8,bridge_name='br-int',has_traffic_filtering=True,id=9179b028-23d4-4b6e-bac0-9df516cc9dfe,network=Network(35b31ce0-80bb-48f2-a9dd-1c30acbca7e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9179b028-23')
Nov 10 21:06:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Deleting instance files /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869_del
Nov 10 21:06:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Deletion of /opt/stack/data/nova/instances/ec5dca1b-b623-4a12-af56-aa2bce208869_del complete
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver [None req-3906a571-3342-4fbf-9bce-1fc7c8bc23a5 tempest-VolumesAssistedSnapshotsTest-1844356727 tempest-VolumesAssistedSnapshotsTest-1844356727-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver 
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver 
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-a902d3c1-57ce-428d-a4da-2a61839d943e)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver 
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver 
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 10 21:06:37 user nova-compute[75285]: ERROR nova.virt.libvirt.driver 
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server [None req-3906a571-3342-4fbf-9bce-1fc7c8bc23a5 tempest-VolumesAssistedSnapshotsTest-1844356727 tempest-VolumesAssistedSnapshotsTest-1844356727-project] Exception during message handling: KeyError: 'type'
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 10 21:06:37 user nova-compute[75285]: ERROR oslo_messaging.rpc.server 
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Checking UEFI support for host arch (x86_64) {{(pid=75285) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 10 21:06:37 user nova-compute[75285]: INFO nova.virt.libvirt.host [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] UEFI support detected
Nov 10 21:06:37 user nova-compute[75285]: INFO nova.compute.manager [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 10 21:06:37 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-6db680e7-3e21-4451-a0b1-29f9eca59b2f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-6db680e7-3e21-4451-a0b1-29f9eca59b2f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Acquiring lock "82a83f12-0822-4cd0-8d1b-3f939a601745" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:37 user nova-compute[75285]: INFO nova.compute.manager [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Detaching volume 2a5ace56-4ec9-4554-bccf-5fc57cf44fd1
Nov 10 21:06:38 user nova-compute[75285]: INFO nova.virt.block_device [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Attempting to driver detach volume 2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 from mountpoint /dev/vdb
Nov 10 21:06:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Attempting to detach device vdb from instance 82a83f12-0822-4cd0-8d1b-3f939a601745 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] detach device xml: <disk type="block" device="disk">
Nov 10 21:06:38 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:06:38 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:06:38 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:06:38 user nova-compute[75285]:   <serial>2a5ace56-4ec9-4554-bccf-5fc57cf44fd1</serial>
Nov 10 21:06:38 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:06:38 user nova-compute[75285]: </disk>
Nov 10 21:06:38 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:06:38 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Successfully detached device vdb from instance 82a83f12-0822-4cd0-8d1b-3f939a601745 from the persistent domain config.
Nov 10 21:06:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 82a83f12-0822-4cd0-8d1b-3f939a601745 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] detach device xml: <disk type="block" device="disk">
Nov 10 21:06:38 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:06:38 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:06:38 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:06:38 user nova-compute[75285]:   <serial>2a5ace56-4ec9-4554-bccf-5fc57cf44fd1</serial>
Nov 10 21:06:38 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:06:38 user nova-compute[75285]: </disk>
Nov 10 21:06:38 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Updating instance_info_cache with network_info: [{"id": "6335c90a-8b5b-4619-af6f-e420972d35d0", "address": "fa:16:3e:9b:b6:31", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6335c90a-8b", "ovs_interfaceid": "6335c90a-8b5b-4619-af6f-e420972d35d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-6db680e7-3e21-4451-a0b1-29f9eca59b2f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 136314880 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 82a83f12-0822-4cd0-8d1b-3f939a601745 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:06:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-974b3095-6e20-483d-a736-1d6a37362265 req-a7724753-6eaf-4a66-9ecf-3c7820b9ef2b service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Received event network-vif-deleted-9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:38 user nova-compute[75285]: INFO nova.compute.manager [req-974b3095-6e20-483d-a736-1d6a37362265 req-a7724753-6eaf-4a66-9ecf-3c7820b9ef2b service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Neutron deleted interface 9179b028-23d4-4b6e-bac0-9df516cc9dfe; detaching it from the instance and deleting it from the info cache
Nov 10 21:06:38 user nova-compute[75285]: DEBUG nova.network.neutron [req-974b3095-6e20-483d-a736-1d6a37362265 req-a7724753-6eaf-4a66-9ecf-3c7820b9ef2b service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:06:38 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Took 1.20 seconds to deallocate network for instance.
Nov 10 21:06:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-974b3095-6e20-483d-a736-1d6a37362265 req-a7724753-6eaf-4a66-9ecf-3c7820b9ef2b service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Detach interface failed, port_id=9179b028-23d4-4b6e-bac0-9df516cc9dfe, reason: Instance ec5dca1b-b623-4a12-af56-aa2bce208869 could not be found. {{(pid=75285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received event network-vif-plugged-8f2bb0e5-40d2-4044-b859-039ea6160907 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] Acquiring lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] No waiting events found dispatching network-vif-plugged-8f2bb0e5-40d2-4044-b859-039ea6160907 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:39 user nova-compute[75285]: WARNING nova.compute.manager [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received unexpected event network-vif-plugged-8f2bb0e5-40d2-4044-b859-039ea6160907 for instance with vm_state active and task_state None.
Nov 10 21:06:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Received event network-vif-unplugged-9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] Acquiring lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] No waiting events found dispatching network-vif-unplugged-9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Received event network-vif-unplugged-9179b028-23d4-4b6e-bac0-9df516cc9dfe for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Received event network-vif-plugged-9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] Acquiring lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] No waiting events found dispatching network-vif-plugged-9179b028-23d4-4b6e-bac0-9df516cc9dfe {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:39 user nova-compute[75285]: WARNING nova.compute.manager [req-5e8626ac-c8bd-4ab3-9cef-d6f540519d7d req-e9bae34a-5c07-4534-8ed2-8a85a574a3ff service nova] [instance: ec5dca1b-b623-4a12-af56-aa2bce208869] Received unexpected event network-vif-plugged-9179b028-23d4-4b6e-bac0-9df516cc9dfe for instance with vm_state active and task_state deleting.
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 301989888 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 472907776 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:06:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.810s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:06:40 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Deleted allocations for instance ec5dca1b-b623-4a12-af56-aa2bce208869
Nov 10 21:06:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 628097024 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b7d4d38-1535-4c0c-9f58-57aa8bfcd6bc tempest-AttachSCSIVolumeTestJSON-1853623146 tempest-AttachSCSIVolumeTestJSON-1853623146-project-member] Lock "ec5dca1b-b623-4a12-af56-aa2bce208869" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.636s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 801112064 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:41 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 969932800 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:06:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:41 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:06:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZdEGvyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:06:42 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0a6095-96ba-473b-b6e6-5de9f3550550]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:06:42 user nova-compute[75285]: No targets found.
Nov 10 21:06:42 user nova-compute[75285]: iSNS:
Nov 10 21:06:42 user nova-compute[75285]: No targets found.
Nov 10 21:06:42 user nova-compute[75285]: STATIC:
Nov 10 21:06:42 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d
Nov 10 21:06:42 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:42 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:42 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec
Nov 10 21:06:42 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:42 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:42 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85
Nov 10 21:06:42 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:42 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:42 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1
Nov 10 21:06:42 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:42 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:42 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd
Nov 10 21:06:42 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:42 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:42 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89
Nov 10 21:06:42 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:42 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:42 user nova-compute[75285]: FIRMWARE:
Nov 10 21:06:42 user nova-compute[75285]: No targets found.
Nov 10 21:06:42 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:06:42 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:06:42 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89f7f2b-b7be-4a18-8bdc-eca7ba39446d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c569c2c7-607b-4aa0-ac69-1b19709441a4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)
Nov 10 21:06:42 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:42 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:42 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:42 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:42 user nova-compute[75285]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)
Nov 10 21:06:42 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)
Nov 10 21:06:42 user nova-compute[75285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:06:42 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:42 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:42 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:42 user nova-compute[75285]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)
Nov 10 21:06:42 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a0427d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec'): ({'sde'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Removing single pathed devices sde {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eba44f2-4bf6-465e-9a9e-9cdb82a49ac6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff513f6-d3dc-4a72-a763-5991b6a91065]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Flushing IO for device /dev/sde {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0d6650-325c-41c2-b291-9da12174c255]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa38871e-aed3-4170-9306-04c6ca920c4f]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] SCSI volumes sde have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d49c277-61ec-435e-82c8-420439fce1df]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9dad13-ad6f-4887-a6b7-57ee40bd2719]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260]
Nov 10 21:06:42 user nova-compute[75285]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260] successful.
Nov 10 21:06:42 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e299eb-c142-4f30-8d76-19f9cf665027]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] <== disconnect_volume: return (364ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnrThtWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '8f6ad802-6f8f-42bc-95bd-934f4c9f55c3', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd', 'serial'} {{(pid=75285) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] swap_volume: removing Cinder connection for volume 7e4cfc71-aa34-4830-b7d4-c49ece3e3cec {{(pid=75285) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:43 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:06:43 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:06:43 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7612MB free_disk=25.424217224121094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:06:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 02b4446d-1538-4e80-b93d-5cb904b7b98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 6db680e7-3e21-4451-a0b1-29f9eca59b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 431a5e3b-068c-4da3-8198-85b4dcafd266 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 82a83f12-0822-4cd0-8d1b-3f939a601745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance aa74d6a6-3084-45c9-b15a-2b831077a3ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 4ace88c2-e7f4-4ed8-8ac8-1759f160db04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance e5fd224c-b34e-41b6-9bdf-28c88579b88c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] swap_volume: Updating volume 7e4cfc71-aa34-4830-b7d4-c49ece3e3cec BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "lnrThtWs", "auth_password": "ZVOxbUKEGec5rq", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd"}, "status": "reserved", "instance": "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3", "attached_at": "", "detached_at": "", "volume_id": "e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd", "serial": "e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd', 'no_device': None, 'attachment_id': '9c1db63a-78ed-4430-ae1a-73952193182b'} {{(pid=75285) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cf0ab7f6-a700-433d-a646-208be086d931 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 39.879s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:06:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG os_brick.utils [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d22099-c205-49ac-94c8-328c86827e79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1639ed14-c84e-4cd6-bdf0-64070d2f84ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8988d20e-1508-4ab7-b1da-f11beaa2cc97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afda14b-188c-4e55-b6db-09a6c91748ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:06:45 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:06:45 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[96988e9c-832f-4960-ba35-8450a690ba9d]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:06:45 user nova-compute[75285]: DEBUG os_brick.utils [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:45 user nova-compute[75285]: INFO nova.compute.manager [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Swapping volume e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd for 7e4cfc71-aa34-4830-b7d4-c49ece3e3cec
Nov 10 21:06:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:46 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:06:46 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:06:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:54 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:06:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:54 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:06:54 user nova-compute[75285]: INFO nova.compute.claims [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Claim successful on node user
Nov 10 21:06:55 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG nova.network.neutron [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:06:55 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:06:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG nova.policy [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92fecbd1e3364a73a2b02edfba7e894e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa427a4529a400b9f1067e756f7c681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:06:55 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Creating image(s)
Nov 10 21:06:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "/opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "/opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "/opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.230s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.187s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Successfully created port: 6362417a-7037-4856-a26a-6b9dfb7ceda6 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk 1073741824" returned: 0 in 0.062s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.203s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Cannot resize image /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Ensure instance console log exists: /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:56 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Waiting for libvirt event about the detach of device tap8f2bb0e5-40 with device alias net1 from instance 431a5e3b-068c-4da3-8198-85b4dcafd266 is timed out.
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:90:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f2bb0e5-40"/></interface> {{(pid=75285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c2:90:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f2bb0e5-40"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 10 21:06:56 user nova-compute[75285]:   <name>instance-00000006</name>
Nov 10 21:06:56 user nova-compute[75285]:   <uuid>431a5e3b-068c-4da3-8198-85b4dcafd266</uuid>
Nov 10 21:06:56 user nova-compute[75285]:   <metadata>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:06:56 user nova-compute[75285]:   <nova:package version="0.0.0"/>
Nov 10 21:06:56 user nova-compute[75285]:   <nova:name>tempest-device-tagging-server-1188264763</nova:name>
Nov 10 21:06:56 user nova-compute[75285]:   <nova:creationTime>2023-11-10 21:05:08</nova:creationTime>
Nov 10 21:06:56 user nova-compute[75285]:   <nova:flavor name="m1.tiny">
Nov 10 21:06:56 user nova-compute[75285]:     <nova:memory>512</nova:memory>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:disk>1</nova:disk>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:swap>0</nova:swap>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:vcpus>1</nova:vcpus>
Nov 10 21:06:56 user nova-compute[75285]:   </nova:flavor>
Nov 10 21:06:56 user nova-compute[75285]:   <nova:owner>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:user uuid="0f018af822634a0b8b9902c811637795">tempest-TaggedAttachmentsTest-941419187-project-member</nova:user>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:project uuid="96cc434b2e3e46c3998436f1c6ae971a">tempest-TaggedAttachmentsTest-941419187</nova:project>
Nov 10 21:06:56 user nova-compute[75285]:   </nova:owner>
Nov 10 21:06:56 user nova-compute[75285]:   <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:06:56 user nova-compute[75285]:   <nova:ports>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:port uuid="46353ed3-1736-493a-99b8-580504a9abc9">
Nov 10 21:06:56 user nova-compute[75285]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 21:06:56 user nova-compute[75285]:     </nova:port>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:port uuid="8f2bb0e5-40d2-4044-b859-039ea6160907">
Nov 10 21:06:56 user nova-compute[75285]:       <nova:ip type="fixed" address="10.10.10.69" ipVersion="4"/>
Nov 10 21:06:56 user nova-compute[75285]:     </nova:port>
Nov 10 21:06:56 user nova-compute[75285]:   </nova:ports>
Nov 10 21:06:56 user nova-compute[75285]: </nova:instance>
Nov 10 21:06:56 user nova-compute[75285]:   </metadata>
Nov 10 21:06:56 user nova-compute[75285]:   <memory unit='KiB'>524288</memory>
Nov 10 21:06:56 user nova-compute[75285]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 21:06:56 user nova-compute[75285]:   <vcpu placement='static'>1</vcpu>
Nov 10 21:06:56 user nova-compute[75285]:   <resource>
Nov 10 21:06:56 user nova-compute[75285]:     <partition>/machine</partition>
Nov 10 21:06:56 user nova-compute[75285]:   </resource>
Nov 10 21:06:56 user nova-compute[75285]:   <sysinfo type='smbios'>
Nov 10 21:06:56 user nova-compute[75285]:     <system>
Nov 10 21:06:56 user nova-compute[75285]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 21:06:56 user nova-compute[75285]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 21:06:56 user nova-compute[75285]:       <entry name='version'>0.0.0</entry>
Nov 10 21:06:56 user nova-compute[75285]:       <entry name='serial'>431a5e3b-068c-4da3-8198-85b4dcafd266</entry>
Nov 10 21:06:56 user nova-compute[75285]:       <entry name='uuid'>431a5e3b-068c-4da3-8198-85b4dcafd266</entry>
Nov 10 21:06:56 user nova-compute[75285]:       <entry name='family'>Virtual Machine</entry>
Nov 10 21:06:56 user nova-compute[75285]:     </system>
Nov 10 21:06:56 user nova-compute[75285]:   </sysinfo>
Nov 10 21:06:56 user nova-compute[75285]:   <os>
Nov 10 21:06:56 user nova-compute[75285]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 21:06:56 user nova-compute[75285]:     <boot dev='hd'/>
Nov 10 21:06:56 user nova-compute[75285]:     <smbios mode='sysinfo'/>
Nov 10 21:06:56 user nova-compute[75285]:   </os>
Nov 10 21:06:56 user nova-compute[75285]:   <features>
Nov 10 21:06:56 user nova-compute[75285]:     <acpi/>
Nov 10 21:06:56 user nova-compute[75285]:     <apic/>
Nov 10 21:06:56 user nova-compute[75285]:     <vmcoreinfo state='on'/>
Nov 10 21:06:56 user nova-compute[75285]:   </features>
Nov 10 21:06:56 user nova-compute[75285]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 21:06:56 user nova-compute[75285]:     <model fallback='forbid'>Nehalem</model>
Nov 10 21:06:56 user nova-compute[75285]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 21:06:56 user nova-compute[75285]:     <feature policy='require' name='vme'/>
Nov 10 21:06:56 user nova-compute[75285]:     <feature policy='require' name='x2apic'/>
Nov 10 21:06:56 user nova-compute[75285]:     <feature policy='require' name='hypervisor'/>
Nov 10 21:06:56 user nova-compute[75285]:   </cpu>
Nov 10 21:06:56 user nova-compute[75285]:   <clock offset='utc'>
Nov 10 21:06:56 user nova-compute[75285]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 21:06:56 user nova-compute[75285]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 21:06:56 user nova-compute[75285]:     <timer name='hpet' present='no'/>
Nov 10 21:06:56 user nova-compute[75285]:   </clock>
Nov 10 21:06:56 user nova-compute[75285]:   <on_poweroff>destroy</on_poweroff>
Nov 10 21:06:56 user nova-compute[75285]:   <on_reboot>restart</on_reboot>
Nov 10 21:06:56 user nova-compute[75285]:   <on_crash>destroy</on_crash>
Nov 10 21:06:56 user nova-compute[75285]:   <devices>
Nov 10 21:06:56 user nova-compute[75285]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 21:06:56 user nova-compute[75285]:     <disk type='file' device='disk'>
Nov 10 21:06:56 user nova-compute[75285]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 21:06:56 user nova-compute[75285]:       <source file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk' index='2'/>
Nov 10 21:06:56 user nova-compute[75285]:       <backingStore type='file' index='3'>
Nov 10 21:06:56 user nova-compute[75285]:         <format type='raw'/>
Nov 10 21:06:56 user nova-compute[75285]:         <source file='/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1'/>
Nov 10 21:06:56 user nova-compute[75285]:         <backingStore/>
Nov 10 21:06:56 user nova-compute[75285]:       </backingStore>
Nov 10 21:06:56 user nova-compute[75285]:       <target dev='vda' bus='virtio'/>
Nov 10 21:06:56 user nova-compute[75285]:       <alias name='virtio-disk0'/>
Nov 10 21:06:56 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 21:06:56 user nova-compute[75285]:     </disk>
Nov 10 21:06:56 user nova-compute[75285]:     <disk type='file' device='cdrom'>
Nov 10 21:06:56 user nova-compute[75285]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 21:06:56 user nova-compute[75285]:       <source file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk.config' index='1'/>
Nov 10 21:06:56 user nova-compute[75285]:       <backingStore/>
Nov 10 21:06:56 user nova-compute[75285]:       <target dev='hda' bus='ide'/>
Nov 10 21:06:56 user nova-compute[75285]:       <readonly/>
Nov 10 21:06:56 user nova-compute[75285]:       <alias name='ide0-0-0'/>
Nov 10 21:06:56 user nova-compute[75285]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 21:06:56 user nova-compute[75285]:     </disk>
Nov 10 21:06:56 user nova-compute[75285]:     <controller type='usb' index='0' model='none'>
Nov 10 21:06:56 user nova-compute[75285]:       <alias name='usb'/>
Nov 10 21:06:56 user nova-compute[75285]:     </controller>
Nov 10 21:06:56 user nova-compute[75285]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 21:06:56 user nova-compute[75285]:       <alias name='pci.0'/>
Nov 10 21:06:56 user nova-compute[75285]:     </controller>
Nov 10 21:06:56 user nova-compute[75285]:     <controller type='ide' index='0'>
Nov 10 21:06:56 user nova-compute[75285]:       <alias name='ide'/>
Nov 10 21:06:56 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 21:06:56 user nova-compute[75285]:     </controller>
Nov 10 21:06:56 user nova-compute[75285]:     <interface type='ethernet'>
Nov 10 21:06:56 user nova-compute[75285]:       <mac address='fa:16:3e:06:22:3a'/>
Nov 10 21:06:56 user nova-compute[75285]:       <target dev='tap46353ed3-17'/>
Nov 10 21:06:56 user nova-compute[75285]:       <model type='virtio'/>
Nov 10 21:06:56 user nova-compute[75285]:       <mtu size='1442'/>
Nov 10 21:06:56 user nova-compute[75285]:       <alias name='net0'/>
Nov 10 21:06:56 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 21:06:56 user nova-compute[75285]:     </interface>
Nov 10 21:06:56 user nova-compute[75285]:     <serial type='pty'>
Nov 10 21:06:56 user nova-compute[75285]:       <source path='/dev/pts/5'/>
Nov 10 21:06:56 user nova-compute[75285]:       <log file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/console.log' append='off'/>
Nov 10 21:06:56 user nova-compute[75285]:       <target type='isa-serial' port='0'>
Nov 10 21:06:56 user nova-compute[75285]:         <model name='isa-serial'/>
Nov 10 21:06:56 user nova-compute[75285]:       </target>
Nov 10 21:06:56 user nova-compute[75285]:       <alias name='serial0'/>
Nov 10 21:06:56 user nova-compute[75285]:     </serial>
Nov 10 21:06:56 user nova-compute[75285]:     <console type='pty' tty='/dev/pts/5'>
Nov 10 21:06:56 user nova-compute[75285]:       <source path='/dev/pts/5'/>
Nov 10 21:06:56 user nova-compute[75285]:       <log file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/console.log' append='off'/>
Nov 10 21:06:56 user nova-compute[75285]:       <target type='serial' port='0'/>
Nov 10 21:06:56 user nova-compute[75285]:       <alias name='serial0'/>
Nov 10 21:06:56 user nova-compute[75285]:     </console>
Nov 10 21:06:56 user nova-compute[75285]:     <input type='mouse' bus='ps2'>
Nov 10 21:06:56 user nova-compute[75285]:       <alias name='input0'/>
Nov 10 21:06:56 user nova-compute[75285]:     </input>
Nov 10 21:06:56 user nova-compute[75285]:     <input type='keyboard' bus='ps2'>
Nov 10 21:06:56 user nova-compute[75285]:       <alias name='input1'/>
Nov 10 21:06:56 user nova-compute[75285]:     </input>
Nov 10 21:06:56 user nova-compute[75285]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 10 21:06:56 user nova-compute[75285]:       <listen type='address' address='0.0.0.0'/>
Nov 10 21:06:56 user nova-compute[75285]:     </graphics>
Nov 10 21:06:56 user nova-compute[75285]:     <audio id='1' type='none'/>
Nov 10 21:06:56 user nova-compute[75285]:     <video>
Nov 10 21:06:56 user nova-compute[75285]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 21:06:56 user nova-compute[75285]:       <alias name='video0'/>
Nov 10 21:06:56 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 21:06:56 user nova-compute[75285]:     </video>
Nov 10 21:06:56 user nova-compute[75285]:     <memballoon model='virtio'>
Nov 10 21:06:56 user nova-compute[75285]:       <stats period='10'/>
Nov 10 21:06:56 user nova-compute[75285]:       <alias name='balloon0'/>
Nov 10 21:06:56 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 21:06:56 user nova-compute[75285]:     </memballoon>
Nov 10 21:06:56 user nova-compute[75285]:     <rng model='virtio'>
Nov 10 21:06:56 user nova-compute[75285]:       <backend model='random'>/dev/urandom</backend>
Nov 10 21:06:56 user nova-compute[75285]:       <alias name='rng0'/>
Nov 10 21:06:56 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 21:06:56 user nova-compute[75285]:     </rng>
Nov 10 21:06:56 user nova-compute[75285]:   </devices>
Nov 10 21:06:56 user nova-compute[75285]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 21:06:56 user nova-compute[75285]:     <label>libvirt-431a5e3b-068c-4da3-8198-85b4dcafd266</label>
Nov 10 21:06:56 user nova-compute[75285]:     <imagelabel>libvirt-431a5e3b-068c-4da3-8198-85b4dcafd266</imagelabel>
Nov 10 21:06:56 user nova-compute[75285]:   </seclabel>
Nov 10 21:06:56 user nova-compute[75285]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 21:06:56 user nova-compute[75285]:     <label>+64055:+108</label>
Nov 10 21:06:56 user nova-compute[75285]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 21:06:56 user nova-compute[75285]:   </seclabel>
Nov 10 21:06:56 user nova-compute[75285]: </domain>
Nov 10 21:06:56 user nova-compute[75285]:  {{(pid=75285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 21:06:56 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Successfully detached device tap8f2bb0e5-40 from instance 431a5e3b-068c-4da3-8198-85b4dcafd266 from the live domain config.
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1188264763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1188264763',id=6,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJVDaV9K6SBR1XEp4BdAS6FdSHtLIn40w3r0dF5WwWJ6G68NbKximpSS6o3RxdgTS65FI2WOslaptWqshVaLeSVBsAD2z4r2afuysf1qmQl+94ffn2lCbbP+vU1cmDehA==',key_name='tempest-keypair-1028305531',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:03:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96cc434b2e3e46c3998436f1c6ae971a',ramdisk_id='',reservation_id='r-dswcb0qh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-941419187',owner_user_name='tempest-TaggedAttachmentsTest-941419187-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f018af822634a0b8b9902c811637795',uuid=431a5e3b-068c-4da3-8198-85b4dcafd266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f2bb0e5-40d2-4044-b859-039ea6160907", "address": "fa:16:3e:c2:90:32", "network": {"id": "44f55482-2ba6-4d93-ad7b-18394f52c1e2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1576076603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2bb0e5-40", "ovs_interfaceid": "8f2bb0e5-40d2-4044-b859-039ea6160907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Converting VIF {"id": "8f2bb0e5-40d2-4044-b859-039ea6160907", "address": "fa:16:3e:c2:90:32", "network": {"id": "44f55482-2ba6-4d93-ad7b-18394f52c1e2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1576076603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2bb0e5-40", "ovs_interfaceid": "8f2bb0e5-40d2-4044-b859-039ea6160907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:90:32,bridge_name='br-int',has_traffic_filtering=True,id=8f2bb0e5-40d2-4044-b859-039ea6160907,network=Network(44f55482-2ba6-4d93-ad7b-18394f52c1e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2bb0e5-40') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG os_vif [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:90:32,bridge_name='br-int',has_traffic_filtering=True,id=8f2bb0e5-40d2-4044-b859-039ea6160907,network=Network(44f55482-2ba6-4d93-ad7b-18394f52c1e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2bb0e5-40') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f2bb0e5-40, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb29a075-d519-4575-b676-d63b575d867b) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:56 user nova-compute[75285]: INFO os_vif [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:90:32,bridge_name='br-int',has_traffic_filtering=True,id=8f2bb0e5-40d2-4044-b859-039ea6160907,network=Network(44f55482-2ba6-4d93-ad7b-18394f52c1e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2bb0e5-40')
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:06:56 user nova-compute[75285]:   <nova:package version="0.0.0"/>
Nov 10 21:06:56 user nova-compute[75285]:   <nova:name>tempest-device-tagging-server-1188264763</nova:name>
Nov 10 21:06:56 user nova-compute[75285]:   <nova:creationTime>2023-11-10 21:06:56</nova:creationTime>
Nov 10 21:06:56 user nova-compute[75285]:   <nova:flavor name="m1.tiny">
Nov 10 21:06:56 user nova-compute[75285]:     <nova:memory>512</nova:memory>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:disk>1</nova:disk>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:swap>0</nova:swap>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:vcpus>1</nova:vcpus>
Nov 10 21:06:56 user nova-compute[75285]:   </nova:flavor>
Nov 10 21:06:56 user nova-compute[75285]:   <nova:owner>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:user uuid="0f018af822634a0b8b9902c811637795">tempest-TaggedAttachmentsTest-941419187-project-member</nova:user>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:project uuid="96cc434b2e3e46c3998436f1c6ae971a">tempest-TaggedAttachmentsTest-941419187</nova:project>
Nov 10 21:06:56 user nova-compute[75285]:   </nova:owner>
Nov 10 21:06:56 user nova-compute[75285]:   <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:06:56 user nova-compute[75285]:   <nova:ports>
Nov 10 21:06:56 user nova-compute[75285]:     <nova:port uuid="46353ed3-1736-493a-99b8-580504a9abc9">
Nov 10 21:06:56 user nova-compute[75285]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 21:06:56 user nova-compute[75285]:     </nova:port>
Nov 10 21:06:56 user nova-compute[75285]:   </nova:ports>
Nov 10 21:06:56 user nova-compute[75285]: </nova:instance>
Nov 10 21:06:56 user nova-compute[75285]:  {{(pid=75285) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Successfully updated port: 6362417a-7037-4856-a26a-6b9dfb7ceda6 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "refresh_cache-ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquired lock "refresh_cache-ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-ba630df7-6d8f-49fa-98df-3054a69660c4 req-16e4fc37-d75a-42e7-b680-85acceeef42d service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Received event network-changed-6362417a-7037-4856-a26a-6b9dfb7ceda6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-ba630df7-6d8f-49fa-98df-3054a69660c4 req-16e4fc37-d75a-42e7-b680-85acceeef42d service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Refreshing instance network info cache due to event network-changed-6362417a-7037-4856-a26a-6b9dfb7ceda6. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ba630df7-6d8f-49fa-98df-3054a69660c4 req-16e4fc37-d75a-42e7-b680-85acceeef42d service nova] Acquiring lock "refresh_cache-ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:06:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.neutron [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Updating instance_info_cache with network_info: [{"id": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "address": "fa:16:3e:94:a8:32", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362417a-70", "ovs_interfaceid": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Releasing lock "refresh_cache-ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Instance network_info: |[{"id": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "address": "fa:16:3e:94:a8:32", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362417a-70", "ovs_interfaceid": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ba630df7-6d8f-49fa-98df-3054a69660c4 req-16e4fc37-d75a-42e7-b680-85acceeef42d service nova] Acquired lock "refresh_cache-ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.neutron [req-ba630df7-6d8f-49fa-98df-3054a69660c4 req-16e4fc37-d75a-42e7-b680-85acceeef42d service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Refreshing network info cache for port 6362417a-7037-4856-a26a-6b9dfb7ceda6 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Start _get_guest_xml network_info=[{"id": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "address": "fa:16:3e:94:a8:32", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362417a-70", "ovs_interfaceid": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:06:57 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:06:57 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1205085645',display_name='tempest-VolumesAdminNegativeTest-server-1205085645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1205085645',id=12,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfa427a4529a400b9f1067e756f7c681',ramdisk_id='',reservation_id='r-996kp52t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-554707513',owner_user_name='tempest-VolumesAdminNegativeTest-554707513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:06:55Z,user_data=None,user_id='92fecbd1e3364a73a2b02edfba7e894e',uuid=ceb3b8d9-56f2-46b8-bf25-7e898328ee6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "address": "fa:16:3e:94:a8:32", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362417a-70", "ovs_interfaceid": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Converting VIF {"id": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "address": "fa:16:3e:94:a8:32", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362417a-70", "ovs_interfaceid": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=6362417a-7037-4856-a26a-6b9dfb7ceda6,network=Network(ed40fbcd-a68a-4582-805a-09cdd3206893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6362417a-70') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.objects.instance [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lazy-loading 'pci_devices' on Instance uuid ceb3b8d9-56f2-46b8-bf25-7e898328ee6b {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:06:57 user nova-compute[75285]:   <uuid>ceb3b8d9-56f2-46b8-bf25-7e898328ee6b</uuid>
Nov 10 21:06:57 user nova-compute[75285]:   <name>instance-0000000c</name>
Nov 10 21:06:57 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:06:57 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:06:57 user nova-compute[75285]:   <metadata>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:06:57 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:06:57 user nova-compute[75285]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1205085645</nova:name>
Nov 10 21:06:57 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:06:57</nova:creationTime>
Nov 10 21:06:57 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:06:57 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:06:57 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:06:57 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:06:57 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:06:57 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:06:57 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:06:57 user nova-compute[75285]:       <nova:owner>
Nov 10 21:06:57 user nova-compute[75285]:         <nova:user uuid="92fecbd1e3364a73a2b02edfba7e894e">tempest-VolumesAdminNegativeTest-554707513-project-member</nova:user>
Nov 10 21:06:57 user nova-compute[75285]:         <nova:project uuid="dfa427a4529a400b9f1067e756f7c681">tempest-VolumesAdminNegativeTest-554707513</nova:project>
Nov 10 21:06:57 user nova-compute[75285]:       </nova:owner>
Nov 10 21:06:57 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:06:57 user nova-compute[75285]:       <nova:ports>
Nov 10 21:06:57 user nova-compute[75285]:         <nova:port uuid="6362417a-7037-4856-a26a-6b9dfb7ceda6">
Nov 10 21:06:57 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 21:06:57 user nova-compute[75285]:         </nova:port>
Nov 10 21:06:57 user nova-compute[75285]:       </nova:ports>
Nov 10 21:06:57 user nova-compute[75285]:     </nova:instance>
Nov 10 21:06:57 user nova-compute[75285]:   </metadata>
Nov 10 21:06:57 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:06:57 user nova-compute[75285]:     <system>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name="serial">ceb3b8d9-56f2-46b8-bf25-7e898328ee6b</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name="uuid">ceb3b8d9-56f2-46b8-bf25-7e898328ee6b</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:06:57 user nova-compute[75285]:     </system>
Nov 10 21:06:57 user nova-compute[75285]:   </sysinfo>
Nov 10 21:06:57 user nova-compute[75285]:   <os>
Nov 10 21:06:57 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:06:57 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:06:57 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:06:57 user nova-compute[75285]:   </os>
Nov 10 21:06:57 user nova-compute[75285]:   <features>
Nov 10 21:06:57 user nova-compute[75285]:     <acpi/>
Nov 10 21:06:57 user nova-compute[75285]:     <apic/>
Nov 10 21:06:57 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:06:57 user nova-compute[75285]:   </features>
Nov 10 21:06:57 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:06:57 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:06:57 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:06:57 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:06:57 user nova-compute[75285]:   </clock>
Nov 10 21:06:57 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:06:57 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:06:57 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:06:57 user nova-compute[75285]:   </cpu>
Nov 10 21:06:57 user nova-compute[75285]:   <devices>
Nov 10 21:06:57 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:06:57 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:06:57 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk"/>
Nov 10 21:06:57 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:06:57 user nova-compute[75285]:     </disk>
Nov 10 21:06:57 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:06:57 user nova-compute[75285]:       <mac address="fa:16:3e:94:a8:32"/>
Nov 10 21:06:57 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:06:57 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:06:57 user nova-compute[75285]:       <target dev="tap6362417a-70"/>
Nov 10 21:06:57 user nova-compute[75285]:     </interface>
Nov 10 21:06:57 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:06:57 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/console.log" append="off"/>
Nov 10 21:06:57 user nova-compute[75285]:     </serial>
Nov 10 21:06:57 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:06:57 user nova-compute[75285]:     <video>
Nov 10 21:06:57 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:06:57 user nova-compute[75285]:     </video>
Nov 10 21:06:57 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:06:57 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:06:57 user nova-compute[75285]:     </rng>
Nov 10 21:06:57 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:06:57 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:06:57 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:06:57 user nova-compute[75285]:     </memballoon>
Nov 10 21:06:57 user nova-compute[75285]:   </devices>
Nov 10 21:06:57 user nova-compute[75285]: </domain>
Nov 10 21:06:57 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1205085645',display_name='tempest-VolumesAdminNegativeTest-server-1205085645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1205085645',id=12,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfa427a4529a400b9f1067e756f7c681',ramdisk_id='',reservation_id='r-996kp52t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-554707513',owner_user_name='tempest-VolumesAdminNegativeTest-554707513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:06:55Z,user_data=None,user_id='92fecbd1e3364a73a2b02edfba7e894e',uuid=ceb3b8d9-56f2-46b8-bf25-7e898328ee6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "address": "fa:16:3e:94:a8:32", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362417a-70", "ovs_interfaceid": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Converting VIF {"id": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "address": "fa:16:3e:94:a8:32", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362417a-70", "ovs_interfaceid": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=6362417a-7037-4856-a26a-6b9dfb7ceda6,network=Network(ed40fbcd-a68a-4582-805a-09cdd3206893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6362417a-70') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG os_vif [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=6362417a-7037-4856-a26a-6b9dfb7ceda6,network=Network(ed40fbcd-a68a-4582-805a-09cdd3206893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6362417a-70') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30f3e26b-8283-5ee6-ba94-5d161e157ad1', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6362417a-70, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6362417a-70, col_values=(('qos', UUID('a4a3659c-2e90-4eec-8de8-c07d54d45b16')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6362417a-70, col_values=(('external_ids', {'iface-id': '6362417a-7037-4856-a26a-6b9dfb7ceda6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:a8:32', 'vm-uuid': 'ceb3b8d9-56f2-46b8-bf25-7e898328ee6b'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:57 user nova-compute[75285]: INFO os_vif [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=6362417a-7037-4856-a26a-6b9dfb7ceda6,network=Network(ed40fbcd-a68a-4582-805a-09cdd3206893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6362417a-70')
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] No VIF found with MAC fa:16:3e:94:a8:32, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received event network-vif-deleted-8f2bb0e5-40d2-4044-b859-039ea6160907 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:57 user nova-compute[75285]: INFO nova.compute.manager [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Neutron deleted interface 8f2bb0e5-40d2-4044-b859-039ea6160907; detaching it from the instance and deleting it from the info cache
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.neutron [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Updating instance_info_cache with network_info: [{"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquired lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.neutron [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.objects.instance [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] Lazy-loading 'system_metadata' on Instance uuid 431a5e3b-068c-4da3-8198-85b4dcafd266 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.objects.instance [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] Lazy-loading 'flavor' on Instance uuid 431a5e3b-068c-4da3-8198-85b4dcafd266 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.objects.base [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] Object Instance<431a5e3b-068c-4da3-8198-85b4dcafd266> lazy-loaded attributes: system_metadata,flavor {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1188264763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1188264763',id=6,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJVDaV9K6SBR1XEp4BdAS6FdSHtLIn40w3r0dF5WwWJ6G68NbKximpSS6o3RxdgTS65FI2WOslaptWqshVaLeSVBsAD2z4r2afuysf1qmQl+94ffn2lCbbP+vU1cmDehA==',key_name='tempest-keypair-1028305531',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:03:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96cc434b2e3e46c3998436f1c6ae971a',ramdisk_id='',reservation_id='r-dswcb0qh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-941419187',owner_user_name='tempest-TaggedAttachmentsTest-941419187-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f018af822634a0b8b9902c811637795',uuid=431a5e3b-068c-4da3-8198-85b4dcafd266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f2bb0e5-40d2-4044-b859-039ea6160907", "address": "fa:16:3e:c2:90:32", "network": {"id": "44f55482-2ba6-4d93-ad7b-18394f52c1e2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1576076603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2bb0e5-40", "ovs_interfaceid": "8f2bb0e5-40d2-4044-b859-039ea6160907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] Converting VIF {"id": "8f2bb0e5-40d2-4044-b859-039ea6160907", "address": "fa:16:3e:c2:90:32", "network": {"id": "44f55482-2ba6-4d93-ad7b-18394f52c1e2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1576076603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2bb0e5-40", "ovs_interfaceid": "8f2bb0e5-40d2-4044-b859-039ea6160907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:90:32,bridge_name='br-int',has_traffic_filtering=True,id=8f2bb0e5-40d2-4044-b859-039ea6160907,network=Network(44f55482-2ba6-4d93-ad7b-18394f52c1e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2bb0e5-40') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:90:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f2bb0e5-40"/></interface> {{(pid=75285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c2:90:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f2bb0e5-40"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 10 21:06:57 user nova-compute[75285]:   <name>instance-00000006</name>
Nov 10 21:06:57 user nova-compute[75285]:   <uuid>431a5e3b-068c-4da3-8198-85b4dcafd266</uuid>
Nov 10 21:06:57 user nova-compute[75285]:   <metadata>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:06:57 user nova-compute[75285]:   <nova:package version="0.0.0"/>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:name>tempest-device-tagging-server-1188264763</nova:name>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:creationTime>2023-11-10 21:06:56</nova:creationTime>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:flavor name="m1.tiny">
Nov 10 21:06:57 user nova-compute[75285]:     <nova:memory>512</nova:memory>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:disk>1</nova:disk>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:swap>0</nova:swap>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:vcpus>1</nova:vcpus>
Nov 10 21:06:57 user nova-compute[75285]:   </nova:flavor>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:owner>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:user uuid="0f018af822634a0b8b9902c811637795">tempest-TaggedAttachmentsTest-941419187-project-member</nova:user>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:project uuid="96cc434b2e3e46c3998436f1c6ae971a">tempest-TaggedAttachmentsTest-941419187</nova:project>
Nov 10 21:06:57 user nova-compute[75285]:   </nova:owner>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:ports>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:port uuid="46353ed3-1736-493a-99b8-580504a9abc9">
Nov 10 21:06:57 user nova-compute[75285]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 21:06:57 user nova-compute[75285]:     </nova:port>
Nov 10 21:06:57 user nova-compute[75285]:   </nova:ports>
Nov 10 21:06:57 user nova-compute[75285]: </nova:instance>
Nov 10 21:06:57 user nova-compute[75285]:   </metadata>
Nov 10 21:06:57 user nova-compute[75285]:   <memory unit='KiB'>524288</memory>
Nov 10 21:06:57 user nova-compute[75285]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 21:06:57 user nova-compute[75285]:   <vcpu placement='static'>1</vcpu>
Nov 10 21:06:57 user nova-compute[75285]:   <resource>
Nov 10 21:06:57 user nova-compute[75285]:     <partition>/machine</partition>
Nov 10 21:06:57 user nova-compute[75285]:   </resource>
Nov 10 21:06:57 user nova-compute[75285]:   <sysinfo type='smbios'>
Nov 10 21:06:57 user nova-compute[75285]:     <system>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name='version'>0.0.0</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name='serial'>431a5e3b-068c-4da3-8198-85b4dcafd266</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name='uuid'>431a5e3b-068c-4da3-8198-85b4dcafd266</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name='family'>Virtual Machine</entry>
Nov 10 21:06:57 user nova-compute[75285]:     </system>
Nov 10 21:06:57 user nova-compute[75285]:   </sysinfo>
Nov 10 21:06:57 user nova-compute[75285]:   <os>
Nov 10 21:06:57 user nova-compute[75285]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 21:06:57 user nova-compute[75285]:     <boot dev='hd'/>
Nov 10 21:06:57 user nova-compute[75285]:     <smbios mode='sysinfo'/>
Nov 10 21:06:57 user nova-compute[75285]:   </os>
Nov 10 21:06:57 user nova-compute[75285]:   <features>
Nov 10 21:06:57 user nova-compute[75285]:     <acpi/>
Nov 10 21:06:57 user nova-compute[75285]:     <apic/>
Nov 10 21:06:57 user nova-compute[75285]:     <vmcoreinfo state='on'/>
Nov 10 21:06:57 user nova-compute[75285]:   </features>
Nov 10 21:06:57 user nova-compute[75285]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 21:06:57 user nova-compute[75285]:     <model fallback='forbid'>Nehalem</model>
Nov 10 21:06:57 user nova-compute[75285]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 21:06:57 user nova-compute[75285]:     <feature policy='require' name='vme'/>
Nov 10 21:06:57 user nova-compute[75285]:     <feature policy='require' name='x2apic'/>
Nov 10 21:06:57 user nova-compute[75285]:     <feature policy='require' name='hypervisor'/>
Nov 10 21:06:57 user nova-compute[75285]:   </cpu>
Nov 10 21:06:57 user nova-compute[75285]:   <clock offset='utc'>
Nov 10 21:06:57 user nova-compute[75285]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 21:06:57 user nova-compute[75285]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 21:06:57 user nova-compute[75285]:     <timer name='hpet' present='no'/>
Nov 10 21:06:57 user nova-compute[75285]:   </clock>
Nov 10 21:06:57 user nova-compute[75285]:   <on_poweroff>destroy</on_poweroff>
Nov 10 21:06:57 user nova-compute[75285]:   <on_reboot>restart</on_reboot>
Nov 10 21:06:57 user nova-compute[75285]:   <on_crash>destroy</on_crash>
Nov 10 21:06:57 user nova-compute[75285]:   <devices>
Nov 10 21:06:57 user nova-compute[75285]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 21:06:57 user nova-compute[75285]:     <disk type='file' device='disk'>
Nov 10 21:06:57 user nova-compute[75285]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 21:06:57 user nova-compute[75285]:       <source file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk' index='2'/>
Nov 10 21:06:57 user nova-compute[75285]:       <backingStore type='file' index='3'>
Nov 10 21:06:57 user nova-compute[75285]:         <format type='raw'/>
Nov 10 21:06:57 user nova-compute[75285]:         <source file='/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1'/>
Nov 10 21:06:57 user nova-compute[75285]:         <backingStore/>
Nov 10 21:06:57 user nova-compute[75285]:       </backingStore>
Nov 10 21:06:57 user nova-compute[75285]:       <target dev='vda' bus='virtio'/>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='virtio-disk0'/>
Nov 10 21:06:57 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </disk>
Nov 10 21:06:57 user nova-compute[75285]:     <disk type='file' device='cdrom'>
Nov 10 21:06:57 user nova-compute[75285]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 21:06:57 user nova-compute[75285]:       <source file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk.config' index='1'/>
Nov 10 21:06:57 user nova-compute[75285]:       <backingStore/>
Nov 10 21:06:57 user nova-compute[75285]:       <target dev='hda' bus='ide'/>
Nov 10 21:06:57 user nova-compute[75285]:       <readonly/>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='ide0-0-0'/>
Nov 10 21:06:57 user nova-compute[75285]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </disk>
Nov 10 21:06:57 user nova-compute[75285]:     <controller type='usb' index='0' model='none'>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='usb'/>
Nov 10 21:06:57 user nova-compute[75285]:     </controller>
Nov 10 21:06:57 user nova-compute[75285]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='pci.0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </controller>
Nov 10 21:06:57 user nova-compute[75285]:     <controller type='ide' index='0'>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='ide'/>
Nov 10 21:06:57 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 21:06:57 user nova-compute[75285]:     </controller>
Nov 10 21:06:57 user nova-compute[75285]:     <interface type='ethernet'>
Nov 10 21:06:57 user nova-compute[75285]:       <mac address='fa:16:3e:06:22:3a'/>
Nov 10 21:06:57 user nova-compute[75285]:       <target dev='tap46353ed3-17'/>
Nov 10 21:06:57 user nova-compute[75285]:       <model type='virtio'/>
Nov 10 21:06:57 user nova-compute[75285]:       <mtu size='1442'/>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='net0'/>
Nov 10 21:06:57 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </interface>
Nov 10 21:06:57 user nova-compute[75285]:     <serial type='pty'>
Nov 10 21:06:57 user nova-compute[75285]:       <source path='/dev/pts/5'/>
Nov 10 21:06:57 user nova-compute[75285]:       <log file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/console.log' append='off'/>
Nov 10 21:06:57 user nova-compute[75285]:       <target type='isa-serial' port='0'>
Nov 10 21:06:57 user nova-compute[75285]:         <model name='isa-serial'/>
Nov 10 21:06:57 user nova-compute[75285]:       </target>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='serial0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </serial>
Nov 10 21:06:57 user nova-compute[75285]:     <console type='pty' tty='/dev/pts/5'>
Nov 10 21:06:57 user nova-compute[75285]:       <source path='/dev/pts/5'/>
Nov 10 21:06:57 user nova-compute[75285]:       <log file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/console.log' append='off'/>
Nov 10 21:06:57 user nova-compute[75285]:       <target type='serial' port='0'/>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='serial0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </console>
Nov 10 21:06:57 user nova-compute[75285]:     <input type='mouse' bus='ps2'>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='input0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </input>
Nov 10 21:06:57 user nova-compute[75285]:     <input type='keyboard' bus='ps2'>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='input1'/>
Nov 10 21:06:57 user nova-compute[75285]:     </input>
Nov 10 21:06:57 user nova-compute[75285]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 10 21:06:57 user nova-compute[75285]:       <listen type='address' address='0.0.0.0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </graphics>
Nov 10 21:06:57 user nova-compute[75285]:     <audio id='1' type='none'/>
Nov 10 21:06:57 user nova-compute[75285]:     <video>
Nov 10 21:06:57 user nova-compute[75285]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='video0'/>
Nov 10 21:06:57 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </video>
Nov 10 21:06:57 user nova-compute[75285]:     <memballoon model='virtio'>
Nov 10 21:06:57 user nova-compute[75285]:       <stats period='10'/>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='balloon0'/>
Nov 10 21:06:57 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </memballoon>
Nov 10 21:06:57 user nova-compute[75285]:     <rng model='virtio'>
Nov 10 21:06:57 user nova-compute[75285]:       <backend model='random'>/dev/urandom</backend>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='rng0'/>
Nov 10 21:06:57 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </rng>
Nov 10 21:06:57 user nova-compute[75285]:   </devices>
Nov 10 21:06:57 user nova-compute[75285]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 21:06:57 user nova-compute[75285]:     <label>libvirt-431a5e3b-068c-4da3-8198-85b4dcafd266</label>
Nov 10 21:06:57 user nova-compute[75285]:     <imagelabel>libvirt-431a5e3b-068c-4da3-8198-85b4dcafd266</imagelabel>
Nov 10 21:06:57 user nova-compute[75285]:   </seclabel>
Nov 10 21:06:57 user nova-compute[75285]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 21:06:57 user nova-compute[75285]:     <label>+64055:+108</label>
Nov 10 21:06:57 user nova-compute[75285]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 21:06:57 user nova-compute[75285]:   </seclabel>
Nov 10 21:06:57 user nova-compute[75285]: </domain>
Nov 10 21:06:57 user nova-compute[75285]:  {{(pid=75285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c2:90:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f2bb0e5-40"/></interface> {{(pid=75285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c2:90:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap8f2bb0e5-40"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 10 21:06:57 user nova-compute[75285]:   <name>instance-00000006</name>
Nov 10 21:06:57 user nova-compute[75285]:   <uuid>431a5e3b-068c-4da3-8198-85b4dcafd266</uuid>
Nov 10 21:06:57 user nova-compute[75285]:   <metadata>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:06:57 user nova-compute[75285]:   <nova:package version="0.0.0"/>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:name>tempest-device-tagging-server-1188264763</nova:name>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:creationTime>2023-11-10 21:06:56</nova:creationTime>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:flavor name="m1.tiny">
Nov 10 21:06:57 user nova-compute[75285]:     <nova:memory>512</nova:memory>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:disk>1</nova:disk>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:swap>0</nova:swap>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:vcpus>1</nova:vcpus>
Nov 10 21:06:57 user nova-compute[75285]:   </nova:flavor>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:owner>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:user uuid="0f018af822634a0b8b9902c811637795">tempest-TaggedAttachmentsTest-941419187-project-member</nova:user>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:project uuid="96cc434b2e3e46c3998436f1c6ae971a">tempest-TaggedAttachmentsTest-941419187</nova:project>
Nov 10 21:06:57 user nova-compute[75285]:   </nova:owner>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:ports>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:port uuid="46353ed3-1736-493a-99b8-580504a9abc9">
Nov 10 21:06:57 user nova-compute[75285]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 21:06:57 user nova-compute[75285]:     </nova:port>
Nov 10 21:06:57 user nova-compute[75285]:   </nova:ports>
Nov 10 21:06:57 user nova-compute[75285]: </nova:instance>
Nov 10 21:06:57 user nova-compute[75285]:   </metadata>
Nov 10 21:06:57 user nova-compute[75285]:   <memory unit='KiB'>524288</memory>
Nov 10 21:06:57 user nova-compute[75285]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 21:06:57 user nova-compute[75285]:   <vcpu placement='static'>1</vcpu>
Nov 10 21:06:57 user nova-compute[75285]:   <resource>
Nov 10 21:06:57 user nova-compute[75285]:     <partition>/machine</partition>
Nov 10 21:06:57 user nova-compute[75285]:   </resource>
Nov 10 21:06:57 user nova-compute[75285]:   <sysinfo type='smbios'>
Nov 10 21:06:57 user nova-compute[75285]:     <system>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name='version'>0.0.0</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name='serial'>431a5e3b-068c-4da3-8198-85b4dcafd266</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name='uuid'>431a5e3b-068c-4da3-8198-85b4dcafd266</entry>
Nov 10 21:06:57 user nova-compute[75285]:       <entry name='family'>Virtual Machine</entry>
Nov 10 21:06:57 user nova-compute[75285]:     </system>
Nov 10 21:06:57 user nova-compute[75285]:   </sysinfo>
Nov 10 21:06:57 user nova-compute[75285]:   <os>
Nov 10 21:06:57 user nova-compute[75285]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 21:06:57 user nova-compute[75285]:     <boot dev='hd'/>
Nov 10 21:06:57 user nova-compute[75285]:     <smbios mode='sysinfo'/>
Nov 10 21:06:57 user nova-compute[75285]:   </os>
Nov 10 21:06:57 user nova-compute[75285]:   <features>
Nov 10 21:06:57 user nova-compute[75285]:     <acpi/>
Nov 10 21:06:57 user nova-compute[75285]:     <apic/>
Nov 10 21:06:57 user nova-compute[75285]:     <vmcoreinfo state='on'/>
Nov 10 21:06:57 user nova-compute[75285]:   </features>
Nov 10 21:06:57 user nova-compute[75285]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 21:06:57 user nova-compute[75285]:     <model fallback='forbid'>Nehalem</model>
Nov 10 21:06:57 user nova-compute[75285]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 21:06:57 user nova-compute[75285]:     <feature policy='require' name='vme'/>
Nov 10 21:06:57 user nova-compute[75285]:     <feature policy='require' name='x2apic'/>
Nov 10 21:06:57 user nova-compute[75285]:     <feature policy='require' name='hypervisor'/>
Nov 10 21:06:57 user nova-compute[75285]:   </cpu>
Nov 10 21:06:57 user nova-compute[75285]:   <clock offset='utc'>
Nov 10 21:06:57 user nova-compute[75285]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 21:06:57 user nova-compute[75285]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 21:06:57 user nova-compute[75285]:     <timer name='hpet' present='no'/>
Nov 10 21:06:57 user nova-compute[75285]:   </clock>
Nov 10 21:06:57 user nova-compute[75285]:   <on_poweroff>destroy</on_poweroff>
Nov 10 21:06:57 user nova-compute[75285]:   <on_reboot>restart</on_reboot>
Nov 10 21:06:57 user nova-compute[75285]:   <on_crash>destroy</on_crash>
Nov 10 21:06:57 user nova-compute[75285]:   <devices>
Nov 10 21:06:57 user nova-compute[75285]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 21:06:57 user nova-compute[75285]:     <disk type='file' device='disk'>
Nov 10 21:06:57 user nova-compute[75285]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 21:06:57 user nova-compute[75285]:       <source file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk' index='2'/>
Nov 10 21:06:57 user nova-compute[75285]:       <backingStore type='file' index='3'>
Nov 10 21:06:57 user nova-compute[75285]:         <format type='raw'/>
Nov 10 21:06:57 user nova-compute[75285]:         <source file='/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1'/>
Nov 10 21:06:57 user nova-compute[75285]:         <backingStore/>
Nov 10 21:06:57 user nova-compute[75285]:       </backingStore>
Nov 10 21:06:57 user nova-compute[75285]:       <target dev='vda' bus='virtio'/>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='virtio-disk0'/>
Nov 10 21:06:57 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </disk>
Nov 10 21:06:57 user nova-compute[75285]:     <disk type='file' device='cdrom'>
Nov 10 21:06:57 user nova-compute[75285]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 21:06:57 user nova-compute[75285]:       <source file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/disk.config' index='1'/>
Nov 10 21:06:57 user nova-compute[75285]:       <backingStore/>
Nov 10 21:06:57 user nova-compute[75285]:       <target dev='hda' bus='ide'/>
Nov 10 21:06:57 user nova-compute[75285]:       <readonly/>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='ide0-0-0'/>
Nov 10 21:06:57 user nova-compute[75285]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </disk>
Nov 10 21:06:57 user nova-compute[75285]:     <controller type='usb' index='0' model='none'>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='usb'/>
Nov 10 21:06:57 user nova-compute[75285]:     </controller>
Nov 10 21:06:57 user nova-compute[75285]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='pci.0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </controller>
Nov 10 21:06:57 user nova-compute[75285]:     <controller type='ide' index='0'>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='ide'/>
Nov 10 21:06:57 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 21:06:57 user nova-compute[75285]:     </controller>
Nov 10 21:06:57 user nova-compute[75285]:     <interface type='ethernet'>
Nov 10 21:06:57 user nova-compute[75285]:       <mac address='fa:16:3e:06:22:3a'/>
Nov 10 21:06:57 user nova-compute[75285]:       <target dev='tap46353ed3-17'/>
Nov 10 21:06:57 user nova-compute[75285]:       <model type='virtio'/>
Nov 10 21:06:57 user nova-compute[75285]:       <mtu size='1442'/>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='net0'/>
Nov 10 21:06:57 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </interface>
Nov 10 21:06:57 user nova-compute[75285]:     <serial type='pty'>
Nov 10 21:06:57 user nova-compute[75285]:       <source path='/dev/pts/5'/>
Nov 10 21:06:57 user nova-compute[75285]:       <log file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/console.log' append='off'/>
Nov 10 21:06:57 user nova-compute[75285]:       <target type='isa-serial' port='0'>
Nov 10 21:06:57 user nova-compute[75285]:         <model name='isa-serial'/>
Nov 10 21:06:57 user nova-compute[75285]:       </target>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='serial0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </serial>
Nov 10 21:06:57 user nova-compute[75285]:     <console type='pty' tty='/dev/pts/5'>
Nov 10 21:06:57 user nova-compute[75285]:       <source path='/dev/pts/5'/>
Nov 10 21:06:57 user nova-compute[75285]:       <log file='/opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266/console.log' append='off'/>
Nov 10 21:06:57 user nova-compute[75285]:       <target type='serial' port='0'/>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='serial0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </console>
Nov 10 21:06:57 user nova-compute[75285]:     <input type='mouse' bus='ps2'>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='input0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </input>
Nov 10 21:06:57 user nova-compute[75285]:     <input type='keyboard' bus='ps2'>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='input1'/>
Nov 10 21:06:57 user nova-compute[75285]:     </input>
Nov 10 21:06:57 user nova-compute[75285]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 10 21:06:57 user nova-compute[75285]:       <listen type='address' address='0.0.0.0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </graphics>
Nov 10 21:06:57 user nova-compute[75285]:     <audio id='1' type='none'/>
Nov 10 21:06:57 user nova-compute[75285]:     <video>
Nov 10 21:06:57 user nova-compute[75285]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='video0'/>
Nov 10 21:06:57 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </video>
Nov 10 21:06:57 user nova-compute[75285]:     <memballoon model='virtio'>
Nov 10 21:06:57 user nova-compute[75285]:       <stats period='10'/>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='balloon0'/>
Nov 10 21:06:57 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </memballoon>
Nov 10 21:06:57 user nova-compute[75285]:     <rng model='virtio'>
Nov 10 21:06:57 user nova-compute[75285]:       <backend model='random'>/dev/urandom</backend>
Nov 10 21:06:57 user nova-compute[75285]:       <alias name='rng0'/>
Nov 10 21:06:57 user nova-compute[75285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 21:06:57 user nova-compute[75285]:     </rng>
Nov 10 21:06:57 user nova-compute[75285]:   </devices>
Nov 10 21:06:57 user nova-compute[75285]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 21:06:57 user nova-compute[75285]:     <label>libvirt-431a5e3b-068c-4da3-8198-85b4dcafd266</label>
Nov 10 21:06:57 user nova-compute[75285]:     <imagelabel>libvirt-431a5e3b-068c-4da3-8198-85b4dcafd266</imagelabel>
Nov 10 21:06:57 user nova-compute[75285]:   </seclabel>
Nov 10 21:06:57 user nova-compute[75285]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 21:06:57 user nova-compute[75285]:     <label>+64055:+108</label>
Nov 10 21:06:57 user nova-compute[75285]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 21:06:57 user nova-compute[75285]:   </seclabel>
Nov 10 21:06:57 user nova-compute[75285]: </domain>
Nov 10 21:06:57 user nova-compute[75285]:  {{(pid=75285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 21:06:57 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Detaching interface fa:16:3e:c2:90:32 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap8f2bb0e5-40' not found.
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1188264763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1188264763',id=6,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJVDaV9K6SBR1XEp4BdAS6FdSHtLIn40w3r0dF5WwWJ6G68NbKximpSS6o3RxdgTS65FI2WOslaptWqshVaLeSVBsAD2z4r2afuysf1qmQl+94ffn2lCbbP+vU1cmDehA==',key_name='tempest-keypair-1028305531',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:03:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96cc434b2e3e46c3998436f1c6ae971a',ramdisk_id='',reservation_id='r-dswcb0qh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-941419187',owner_user_name='tempest-TaggedAttachmentsTest-941419187-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f018af822634a0b8b9902c811637795',uuid=431a5e3b-068c-4da3-8198-85b4dcafd266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f2bb0e5-40d2-4044-b859-039ea6160907", "address": "fa:16:3e:c2:90:32", "network": {"id": "44f55482-2ba6-4d93-ad7b-18394f52c1e2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1576076603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2bb0e5-40", "ovs_interfaceid": "8f2bb0e5-40d2-4044-b859-039ea6160907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] Converting VIF {"id": "8f2bb0e5-40d2-4044-b859-039ea6160907", "address": "fa:16:3e:c2:90:32", "network": {"id": "44f55482-2ba6-4d93-ad7b-18394f52c1e2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1576076603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2bb0e5-40", "ovs_interfaceid": "8f2bb0e5-40d2-4044-b859-039ea6160907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:90:32,bridge_name='br-int',has_traffic_filtering=True,id=8f2bb0e5-40d2-4044-b859-039ea6160907,network=Network(44f55482-2ba6-4d93-ad7b-18394f52c1e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2bb0e5-40') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG os_vif [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:90:32,bridge_name='br-int',has_traffic_filtering=True,id=8f2bb0e5-40d2-4044-b859-039ea6160907,network=Network(44f55482-2ba6-4d93-ad7b-18394f52c1e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2bb0e5-40') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f2bb0e5-40, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:06:57 user nova-compute[75285]: INFO os_vif [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:90:32,bridge_name='br-int',has_traffic_filtering=True,id=8f2bb0e5-40d2-4044-b859-039ea6160907,network=Network(44f55482-2ba6-4d93-ad7b-18394f52c1e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2bb0e5-40')
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [req-4c290a95-1cc4-4440-acf3-a667a62a4328 req-87251222-a6de-41b3-81be-75a3a24b7ea9 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:06:57 user nova-compute[75285]:   <nova:package version="0.0.0"/>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:name>tempest-device-tagging-server-1188264763</nova:name>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:creationTime>2023-11-10 21:06:57</nova:creationTime>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:flavor name="m1.tiny">
Nov 10 21:06:57 user nova-compute[75285]:     <nova:memory>512</nova:memory>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:disk>1</nova:disk>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:swap>0</nova:swap>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:vcpus>1</nova:vcpus>
Nov 10 21:06:57 user nova-compute[75285]:   </nova:flavor>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:owner>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:user uuid="0f018af822634a0b8b9902c811637795">tempest-TaggedAttachmentsTest-941419187-project-member</nova:user>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:project uuid="96cc434b2e3e46c3998436f1c6ae971a">tempest-TaggedAttachmentsTest-941419187</nova:project>
Nov 10 21:06:57 user nova-compute[75285]:   </nova:owner>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:06:57 user nova-compute[75285]:   <nova:ports>
Nov 10 21:06:57 user nova-compute[75285]:     <nova:port uuid="46353ed3-1736-493a-99b8-580504a9abc9">
Nov 10 21:06:57 user nova-compute[75285]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 21:06:57 user nova-compute[75285]:     </nova:port>
Nov 10 21:06:57 user nova-compute[75285]:   </nova:ports>
Nov 10 21:06:57 user nova-compute[75285]: </nova:instance>
Nov 10 21:06:57 user nova-compute[75285]:  {{(pid=75285) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.neutron [req-ba630df7-6d8f-49fa-98df-3054a69660c4 req-16e4fc37-d75a-42e7-b680-85acceeef42d service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Updated VIF entry in instance network info cache for port 6362417a-7037-4856-a26a-6b9dfb7ceda6. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.neutron [req-ba630df7-6d8f-49fa-98df-3054a69660c4 req-16e4fc37-d75a-42e7-b680-85acceeef42d service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Updating instance_info_cache with network_info: [{"id": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "address": "fa:16:3e:94:a8:32", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362417a-70", "ovs_interfaceid": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ba630df7-6d8f-49fa-98df-3054a69660c4 req-16e4fc37-d75a-42e7-b680-85acceeef42d service nova] Releasing lock "refresh_cache-ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG nova.network.neutron [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Updating instance_info_cache with network_info: [{"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Releasing lock "refresh_cache-431a5e3b-068c-4da3-8198-85b4dcafd266" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:06:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-228915b8-fbfc-4c2f-9798-dc78454b18d3 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "interface-431a5e3b-068c-4da3-8198-85b4dcafd266-8f2bb0e5-40d2-4044-b859-039ea6160907" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.692s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:58 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 82a83f12-0822-4cd0-8d1b-3f939a601745 is timed out.
Nov 10 21:06:58 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Successfully detached device vdb from instance 82a83f12-0822-4cd0-8d1b-3f939a601745 from the live domain config.
Nov 10 21:06:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kdImCpuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:06:58 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22a9d75-cbf3-443d-9c2f-7507b71d0738]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:06:58 user nova-compute[75285]: No targets found.
Nov 10 21:06:58 user nova-compute[75285]: iSNS:
Nov 10 21:06:58 user nova-compute[75285]: No targets found.
Nov 10 21:06:58 user nova-compute[75285]: STATIC:
Nov 10 21:06:58 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d
Nov 10 21:06:58 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:58 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:58 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85
Nov 10 21:06:58 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:58 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:58 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1
Nov 10 21:06:58 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:58 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:58 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd
Nov 10 21:06:58 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:58 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:58 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89
Nov 10 21:06:58 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:06:58 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:06:58 user nova-compute[75285]: FIRMWARE:
Nov 10 21:06:58 user nova-compute[75285]: No targets found.
Nov 10 21:06:58 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:06:58 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:06:58 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d236c45c-10b4-40db-899f-6ffab74834ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[50686c6b-a549-4134-83e0-42484b3d5a93]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)
Nov 10 21:06:58 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:58 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:58 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:58 user nova-compute[75285]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)
Nov 10 21:06:58 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)
Nov 10 21:06:58 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:06:58 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:06:58 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:06:58 user nova-compute[75285]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 (non-flash)
Nov 10 21:06:58 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a0427edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba2aa6c-4785-40d7-bac7-1ab1fbd60d96]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[90310263-9e97-4cd9-8bf2-ce52c99d3176]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[255e56ea-c0f9-4aae-b271-59f129431d20]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb320b5-f918-4d46-b284-9402ce1f5182]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b0b8f8-9612-478e-856f-3665a64f6a6c]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb3eb6c-29ec-4b00-957d-7dfe4298fca1]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1, portal: 172.16.0.220,3260]
Nov 10 21:06:59 user nova-compute[75285]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1, portal: 172.16.0.220,3260] successful.
Nov 10 21:06:59 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5ace56-4ec9-4554-bccf-5fc57cf44fd1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e5e494-f7bc-4e14-a84e-67ce1c6a940a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] <== disconnect_volume: return (358ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-5baa16da-3d23-4dbf-9b44-35a0c94e1024 req-b795ecfd-cbbd-476d-aabe-79551f03b6bd service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Received event network-vif-plugged-6362417a-7037-4856-a26a-6b9dfb7ceda6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5baa16da-3d23-4dbf-9b44-35a0c94e1024 req-b795ecfd-cbbd-476d-aabe-79551f03b6bd service nova] Acquiring lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5baa16da-3d23-4dbf-9b44-35a0c94e1024 req-b795ecfd-cbbd-476d-aabe-79551f03b6bd service nova] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5baa16da-3d23-4dbf-9b44-35a0c94e1024 req-b795ecfd-cbbd-476d-aabe-79551f03b6bd service nova] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-5baa16da-3d23-4dbf-9b44-35a0c94e1024 req-b795ecfd-cbbd-476d-aabe-79551f03b6bd service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] No waiting events found dispatching network-vif-plugged-6362417a-7037-4856-a26a-6b9dfb7ceda6 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:59 user nova-compute[75285]: WARNING nova.compute.manager [req-5baa16da-3d23-4dbf-9b44-35a0c94e1024 req-b795ecfd-cbbd-476d-aabe-79551f03b6bd service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Received unexpected event network-vif-plugged-6362417a-7037-4856-a26a-6b9dfb7ceda6 for instance with vm_state building and task_state spawning.
Nov 10 21:06:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-5baa16da-3d23-4dbf-9b44-35a0c94e1024 req-b795ecfd-cbbd-476d-aabe-79551f03b6bd service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Received event network-vif-plugged-6362417a-7037-4856-a26a-6b9dfb7ceda6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5baa16da-3d23-4dbf-9b44-35a0c94e1024 req-b795ecfd-cbbd-476d-aabe-79551f03b6bd service nova] Acquiring lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5baa16da-3d23-4dbf-9b44-35a0c94e1024 req-b795ecfd-cbbd-476d-aabe-79551f03b6bd service nova] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5baa16da-3d23-4dbf-9b44-35a0c94e1024 req-b795ecfd-cbbd-476d-aabe-79551f03b6bd service nova] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:06:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-5baa16da-3d23-4dbf-9b44-35a0c94e1024 req-b795ecfd-cbbd-476d-aabe-79551f03b6bd service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] No waiting events found dispatching network-vif-plugged-6362417a-7037-4856-a26a-6b9dfb7ceda6 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:06:59 user nova-compute[75285]: WARNING nova.compute.manager [req-5baa16da-3d23-4dbf-9b44-35a0c94e1024 req-b795ecfd-cbbd-476d-aabe-79551f03b6bd service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Received unexpected event network-vif-plugged-6362417a-7037-4856-a26a-6b9dfb7ceda6 for instance with vm_state building and task_state spawning.
Nov 10 21:07:00 user nova-compute[75285]: DEBUG nova.objects.instance [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lazy-loading 'flavor' on Instance uuid 82a83f12-0822-4cd0-8d1b-3f939a601745 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:07:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d3df1151-1725-4733-9f2e-9b28006aafd3 tempest-VolumesAssistedSnapshotsTest-1072058235 tempest-VolumesAssistedSnapshotsTest-1072058235-project-admin] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.447s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:07:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:07:00 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Instance spawned successfully.
Nov 10 21:07:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:07:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:07:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:07:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:07:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:07:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:07:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:07:01 user nova-compute[75285]: INFO nova.compute.manager [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 10 21:07:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:07:01 user nova-compute[75285]: INFO nova.compute.manager [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Took 6.48 seconds to build instance.
Nov 10 21:07:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ccc0baeb-e259-43c8-984e-2b9150538ac9 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.583s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Acquiring lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Acquiring lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:04 user nova-compute[75285]: INFO nova.compute.manager [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Terminating instance
Nov 10 21:07:04 user nova-compute[75285]: DEBUG nova.compute.manager [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:07:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG nova.compute.manager [req-3ed18451-310e-4964-a7b1-1cc7c5a431cd req-5c11e0ef-9712-418c-930e-1a0502c9643f service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Received event network-vif-unplugged-b74c53ea-d0fa-4971-9997-31413b2df6e5 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3ed18451-310e-4964-a7b1-1cc7c5a431cd req-5c11e0ef-9712-418c-930e-1a0502c9643f service nova] Acquiring lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3ed18451-310e-4964-a7b1-1cc7c5a431cd req-5c11e0ef-9712-418c-930e-1a0502c9643f service nova] Lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3ed18451-310e-4964-a7b1-1cc7c5a431cd req-5c11e0ef-9712-418c-930e-1a0502c9643f service nova] Lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG nova.compute.manager [req-3ed18451-310e-4964-a7b1-1cc7c5a431cd req-5c11e0ef-9712-418c-930e-1a0502c9643f service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] No waiting events found dispatching network-vif-unplugged-b74c53ea-d0fa-4971-9997-31413b2df6e5 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG nova.compute.manager [req-3ed18451-310e-4964-a7b1-1cc7c5a431cd req-5c11e0ef-9712-418c-930e-1a0502c9643f service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Received event network-vif-unplugged-b74c53ea-d0fa-4971-9997-31413b2df6e5 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:07:05 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Instance destroyed successfully.
Nov 10 21:07:05 user nova-compute[75285]: DEBUG nova.objects.instance [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lazy-loading 'resources' on Instance uuid 4ace88c2-e7f4-4ed8-8ac8-1759f160db04 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1576916665',display_name='tempest-VolumesActionsTest-instance-1576916665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1576916665',id=10,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:05:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a036a3b23594844903849039ec324ed',ramdisk_id='',reservation_id='r-k3kio371',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1573453425',owner_user_name='tempest-VolumesActionsTest-1573453425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:05:01Z,user_data=None,user_id='405bfc6bb94f44edb16c530658ea8b36',uuid=4ace88c2-e7f4-4ed8-8ac8-1759f160db04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "address": "fa:16:3e:f5:83:24", "network": {"id": "90b53dce-16d8-45a8-a427-f54e01b2bb1d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180545890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a036a3b23594844903849039ec324ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c53ea-d0", "ovs_interfaceid": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Converting VIF {"id": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "address": "fa:16:3e:f5:83:24", "network": {"id": "90b53dce-16d8-45a8-a427-f54e01b2bb1d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-180545890-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a036a3b23594844903849039ec324ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c53ea-d0", "ovs_interfaceid": "b74c53ea-d0fa-4971-9997-31413b2df6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:24,bridge_name='br-int',has_traffic_filtering=True,id=b74c53ea-d0fa-4971-9997-31413b2df6e5,network=Network(90b53dce-16d8-45a8-a427-f54e01b2bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb74c53ea-d0') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG os_vif [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:24,bridge_name='br-int',has_traffic_filtering=True,id=b74c53ea-d0fa-4971-9997-31413b2df6e5,network=Network(90b53dce-16d8-45a8-a427-f54e01b2bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb74c53ea-d0') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb74c53ea-d0, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14a65280-ac5e-4e0e-a4eb-4e9b04f4713b) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:05 user nova-compute[75285]: INFO os_vif [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:24,bridge_name='br-int',has_traffic_filtering=True,id=b74c53ea-d0fa-4971-9997-31413b2df6e5,network=Network(90b53dce-16d8-45a8-a427-f54e01b2bb1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb74c53ea-d0')
Nov 10 21:07:05 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Deleting instance files /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04_del
Nov 10 21:07:05 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Deletion of /opt/stack/data/nova/instances/4ace88c2-e7f4-4ed8-8ac8-1759f160db04_del complete
Nov 10 21:07:05 user nova-compute[75285]: INFO nova.compute.manager [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 10 21:07:05 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:07:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:06 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:07:06 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Took 0.72 seconds to deallocate network for instance.
Nov 10 21:07:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:06 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:07:06 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:07:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:06 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Deleted allocations for instance 4ace88c2-e7f4-4ed8-8ac8-1759f160db04
Nov 10 21:07:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7a2b29ec-affe-4ba0-b462-96b4fa5c39ad tempest-VolumesActionsTest-1573453425 tempest-VolumesActionsTest-1573453425-project-member] Lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.317s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-58d67455-955d-436a-a995-0a4bece7df94 req-2f45e764-6088-4334-a05b-e681018c36ea service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Received event network-vif-plugged-b74c53ea-d0fa-4971-9997-31413b2df6e5 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:07:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-58d67455-955d-436a-a995-0a4bece7df94 req-2f45e764-6088-4334-a05b-e681018c36ea service nova] Acquiring lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-58d67455-955d-436a-a995-0a4bece7df94 req-2f45e764-6088-4334-a05b-e681018c36ea service nova] Lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-58d67455-955d-436a-a995-0a4bece7df94 req-2f45e764-6088-4334-a05b-e681018c36ea service nova] Lock "4ace88c2-e7f4-4ed8-8ac8-1759f160db04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-58d67455-955d-436a-a995-0a4bece7df94 req-2f45e764-6088-4334-a05b-e681018c36ea service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] No waiting events found dispatching network-vif-plugged-b74c53ea-d0fa-4971-9997-31413b2df6e5 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:07:07 user nova-compute[75285]: WARNING nova.compute.manager [req-58d67455-955d-436a-a995-0a4bece7df94 req-2f45e764-6088-4334-a05b-e681018c36ea service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Received unexpected event network-vif-plugged-b74c53ea-d0fa-4971-9997-31413b2df6e5 for instance with vm_state deleted and task_state None.
Nov 10 21:07:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-58d67455-955d-436a-a995-0a4bece7df94 req-2f45e764-6088-4334-a05b-e681018c36ea service nova] [instance: 4ace88c2-e7f4-4ed8-8ac8-1759f160db04] Received event network-vif-deleted-b74c53ea-d0fa-4971-9997-31413b2df6e5 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:07:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZdEGvyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f6ad802-6f8f-42bc-95bd-934f4c9f55c3', 'attached_at': '', 'detached_at': '', 'volume_id': '7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 'serial': '7e4cfc71-aa34-4830-b7d4-c49ece3e3cec'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnrThtWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd'}, 'status': 'reserved', 'instance': '8f6ad802-6f8f-42bc-95bd-934f4c9f55c3', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd', 'serial'} {{(pid=75285) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZdEGvyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:07:14 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:07:14 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:07:14 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec5c8cc-a400-4aa8-beb3-fb88a8e5f535]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:07:14 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9d4830-e37e-4ad4-9427-ca1e3e404210]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec] added
Nov 10 21:07:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75b882e-6ed0-46b5-93c1-0cb11791990c]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a160567c-b349-4374-81d4-508115c10425]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZdEGvyL {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZdEGvyL" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f51ccb8-d7ab-4653-9ac0-d7d87eb97928]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xZdEGvyL'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e702f8f-e4c9-48fd-8191-13c390111c41]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aedfa5d-72d8-468d-87a3-4e3be638b5dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)
Nov 10 21:07:14 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:07:14 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:07:14 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:07:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)
Nov 10 21:07:14 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:07:14 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:07:14 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:07:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f212b9-6ca4-4c9b-95bc-277e6f4aaf3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260]
Nov 10 21:07:14 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260] successful.
Nov 10 21:07:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[509bcd8c-3ad8-442e-abb3-34971c2f7209]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[435c8c21-e261-4190-8779-eaf539d730c4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)
Nov 10 21:07:14 user nova-compute[75285]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:07:14 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:07:14 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:07:14 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:07:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)
Nov 10 21:07:14 user nova-compute[75285]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:07:14 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:07:14 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:07:14 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:07:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3de7696-428f-4903-a59c-83df9b592866]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:07:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:15 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:07:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZdEGvyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:07:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:07:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23661643861373463', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:07:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661643861373463', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:07:15 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lazy-loading 'flavor' on Instance uuid 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:07:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:07:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 164626432 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:07:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 314572800 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:07:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 470810624 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:07:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 592445440 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:07:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 756023296 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 914358272 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnrThtWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:07:19 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9bf12c-ce59-473f-9691-d54a5a680485]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:07:19 user nova-compute[75285]: No targets found.
Nov 10 21:07:19 user nova-compute[75285]: iSNS:
Nov 10 21:07:19 user nova-compute[75285]: No targets found.
Nov 10 21:07:19 user nova-compute[75285]: STATIC:
Nov 10 21:07:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d
Nov 10 21:07:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:07:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:07:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec
Nov 10 21:07:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:07:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:07:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85
Nov 10 21:07:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:07:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:07:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd
Nov 10 21:07:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:07:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:07:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89
Nov 10 21:07:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:07:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:07:19 user nova-compute[75285]: FIRMWARE:
Nov 10 21:07:19 user nova-compute[75285]: No targets found.
Nov 10 21:07:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:07:19 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:07:19 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dab02b4-62fc-46f4-928c-b57b3603f533]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfb2403-d8c2-4a1d-8fe1-7b42ea987d8b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)
Nov 10 21:07:19 user nova-compute[75285]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:07:19 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:07:19 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:07:19 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:07:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd (non-flash)
Nov 10 21:07:19 user nova-compute[75285]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:07:19 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:07:19 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:07:19 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:07:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a079e3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd'): ({'sdc'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Removing single pathed devices sdc {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dddbd6-9b8a-4b28-85b2-a70ca593db52]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e35930a-2b1a-4a34-927e-d7fa6a729ee8]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Flushing IO for device /dev/sdc {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[035fb132-0139-43f7-92c9-edaf62b742a4]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d104bb75-2c45-4710-a920-ab4e342e2217]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ba1ade-823e-415f-be7b-7757b55e28f4]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:07:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf986f0f-bc64-4e58-9c24-6aa2d67e7af8]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd, portal: 172.16.0.220,3260]
Nov 10 21:07:20 user nova-compute[75285]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd, portal: 172.16.0.220,3260] successful.
Nov 10 21:07:20 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:07:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea73484b-557f-4cbb-a180-ba5595273f0d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:07:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:07:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] <== disconnect_volume: return (345ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:07:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:07:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZdEGvyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8f6ad802-6f8f-42bc-95bd-934f4c9f55c3', 'attached_at': '', 'detached_at': '', 'volume_id': '7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 'serial'} {{(pid=75285) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 10 21:07:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] swap_volume: removing Cinder connection for volume e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd {{(pid=75285) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 10 21:07:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:07:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:21 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] swap_volume: Updating volume e8d84eb2-4a79-4b95-b98c-fa5a1ecefcfd BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "xZdEGvyL", "auth_password": "B2TSeN1WykXsQ5", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "7e4cfc71-aa34-4830-b7d4-c49ece3e3cec"}, "status": "reserved", "instance": "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3", "attached_at": "", "detached_at": "", "volume_id": "7e4cfc71-aa34-4830-b7d4-c49ece3e3cec", "serial": "7e4cfc71-aa34-4830-b7d4-c49ece3e3cec"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 'no_device': None, 'attachment_id': '871db051-c0e5-4e7a-813b-867655b2ba01'} {{(pid=75285) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 10 21:07:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2cf09fc8-f5ee-4656-bcc1-7cd2476e0cc5 tempest-TestVolumeSwap-532707983 tempest-TestVolumeSwap-532707983-project-admin] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 35.779s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:21 user nova-compute[75285]: INFO nova.compute.manager [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Detaching volume 7e4cfc71-aa34-4830-b7d4-c49ece3e3cec
Nov 10 21:07:22 user nova-compute[75285]: INFO nova.virt.block_device [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Attempting to driver detach volume 7e4cfc71-aa34-4830-b7d4-c49ece3e3cec from mountpoint /dev/vdb
Nov 10 21:07:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Attempting to detach device vdb from instance 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:07:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:07:22 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:07:22 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:07:22 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:07:22 user nova-compute[75285]:   <serial>7e4cfc71-aa34-4830-b7d4-c49ece3e3cec</serial>
Nov 10 21:07:22 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:07:22 user nova-compute[75285]: </disk>
Nov 10 21:07:22 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:07:22 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Successfully detached device vdb from instance 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 from the persistent domain config.
Nov 10 21:07:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:07:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:07:22 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:07:22 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:07:22 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:07:22 user nova-compute[75285]:   <serial>7e4cfc71-aa34-4830-b7d4-c49ece3e3cec</serial>
Nov 10 21:07:22 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:07:22 user nova-compute[75285]: </disk>
Nov 10 21:07:22 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:07:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:07:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "431a5e3b-068c-4da3-8198-85b4dcafd266" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:27 user nova-compute[75285]: INFO nova.compute.manager [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Terminating instance
Nov 10 21:07:27 user nova-compute[75285]: DEBUG nova.compute.manager [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-af3ad3d7-5566-4e1b-8baa-6153c99c62dd req-c15eb9e1-562b-43d3-a251-67c6db905e6c service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received event network-vif-unplugged-46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-af3ad3d7-5566-4e1b-8baa-6153c99c62dd req-c15eb9e1-562b-43d3-a251-67c6db905e6c service nova] Acquiring lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-af3ad3d7-5566-4e1b-8baa-6153c99c62dd req-c15eb9e1-562b-43d3-a251-67c6db905e6c service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-af3ad3d7-5566-4e1b-8baa-6153c99c62dd req-c15eb9e1-562b-43d3-a251-67c6db905e6c service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-af3ad3d7-5566-4e1b-8baa-6153c99c62dd req-c15eb9e1-562b-43d3-a251-67c6db905e6c service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] No waiting events found dispatching network-vif-unplugged-46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:07:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-af3ad3d7-5566-4e1b-8baa-6153c99c62dd req-c15eb9e1-562b-43d3-a251-67c6db905e6c service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received event network-vif-unplugged-46353ed3-1736-493a-99b8-580504a9abc9 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:07:28 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Instance destroyed successfully.
Nov 10 21:07:28 user nova-compute[75285]: DEBUG nova.objects.instance [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lazy-loading 'resources' on Instance uuid 431a5e3b-068c-4da3-8198-85b4dcafd266 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:07:28 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1188264763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1188264763',id=6,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJVDaV9K6SBR1XEp4BdAS6FdSHtLIn40w3r0dF5WwWJ6G68NbKximpSS6o3RxdgTS65FI2WOslaptWqshVaLeSVBsAD2z4r2afuysf1qmQl+94ffn2lCbbP+vU1cmDehA==',key_name='tempest-keypair-1028305531',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:03:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96cc434b2e3e46c3998436f1c6ae971a',ramdisk_id='',reservation_id='r-dswcb0qh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-941419187',owner_user_name='tempest-TaggedAttachmentsTest-941419187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f018af822634a0b8b9902c811637795',uuid=431a5e3b-068c-4da3-8198-85b4dcafd266,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:07:28 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Converting VIF {"id": "46353ed3-1736-493a-99b8-580504a9abc9", "address": "fa:16:3e:06:22:3a", "network": {"id": "7b398720-77ce-449f-8413-d2f602a7ecd9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-938226113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96cc434b2e3e46c3998436f1c6ae971a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46353ed3-17", "ovs_interfaceid": "46353ed3-1736-493a-99b8-580504a9abc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:07:28 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:22:3a,bridge_name='br-int',has_traffic_filtering=True,id=46353ed3-1736-493a-99b8-580504a9abc9,network=Network(7b398720-77ce-449f-8413-d2f602a7ecd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46353ed3-17') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:07:28 user nova-compute[75285]: DEBUG os_vif [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:22:3a,bridge_name='br-int',has_traffic_filtering=True,id=46353ed3-1736-493a-99b8-580504a9abc9,network=Network(7b398720-77ce-449f-8413-d2f602a7ecd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46353ed3-17') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:07:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46353ed3-17, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:07:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:07:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0975bddf-095e-4856-89fa-0c97d1f81349) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:07:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:28 user nova-compute[75285]: INFO os_vif [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:22:3a,bridge_name='br-int',has_traffic_filtering=True,id=46353ed3-1736-493a-99b8-580504a9abc9,network=Network(7b398720-77ce-449f-8413-d2f602a7ecd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46353ed3-17')
Nov 10 21:07:28 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Deleting instance files /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266_del
Nov 10 21:07:28 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Deletion of /opt/stack/data/nova/instances/431a5e3b-068c-4da3-8198-85b4dcafd266_del complete
Nov 10 21:07:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:28 user nova-compute[75285]: INFO nova.compute.manager [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 10 21:07:28 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:07:28 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:07:28 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:07:29 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:07:29 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Took 0.99 seconds to deallocate network for instance.
Nov 10 21:07:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-c2d57f23-e1cb-4483-a37f-86ce3ee1b3ed req-ff8b0545-7766-436b-88ba-be5e6766d6d0 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received event network-vif-deleted-46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:07:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-a6b57bfd-f000-4f6a-93f5-9f6448b84e55 req-c75f1311-5358-4945-a0e1-6dba9a9b3ba3 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received event network-vif-plugged-46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:07:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a6b57bfd-f000-4f6a-93f5-9f6448b84e55 req-c75f1311-5358-4945-a0e1-6dba9a9b3ba3 service nova] Acquiring lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a6b57bfd-f000-4f6a-93f5-9f6448b84e55 req-c75f1311-5358-4945-a0e1-6dba9a9b3ba3 service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a6b57bfd-f000-4f6a-93f5-9f6448b84e55 req-c75f1311-5358-4945-a0e1-6dba9a9b3ba3 service nova] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-a6b57bfd-f000-4f6a-93f5-9f6448b84e55 req-c75f1311-5358-4945-a0e1-6dba9a9b3ba3 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] No waiting events found dispatching network-vif-plugged-46353ed3-1736-493a-99b8-580504a9abc9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:07:29 user nova-compute[75285]: WARNING nova.compute.manager [req-a6b57bfd-f000-4f6a-93f5-9f6448b84e55 req-c75f1311-5358-4945-a0e1-6dba9a9b3ba3 service nova] [instance: 431a5e3b-068c-4da3-8198-85b4dcafd266] Received unexpected event network-vif-plugged-46353ed3-1736-493a-99b8-580504a9abc9 for instance with vm_state deleted and task_state None.
Nov 10 21:07:29 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:07:29 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:07:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:29 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Deleted allocations for instance 431a5e3b-068c-4da3-8198-85b4dcafd266
Nov 10 21:07:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cba14137-baca-43ce-923f-6911ddf43d51 tempest-TaggedAttachmentsTest-941419187 tempest-TaggedAttachmentsTest-941419187-project-member] Lock "431a5e3b-068c-4da3-8198-85b4dcafd266" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.774s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:33 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:07:34 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:07:34 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:07:35 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:07:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:37 user nova-compute[75285]: INFO nova.compute.manager [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Rescuing
Nov 10 21:07:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquired lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG nova.network.neutron [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG nova.network.neutron [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Updating instance_info_cache with network_info: [{"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Releasing lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-f6c6518f-f7c3-4f78-83cb-d8fe75886a16 req-deb563e4-014f-4021-adb9-48b85bd45cd6 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-vif-unplugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f6c6518f-f7c3-4f78-83cb-d8fe75886a16 req-deb563e4-014f-4021-adb9-48b85bd45cd6 service nova] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f6c6518f-f7c3-4f78-83cb-d8fe75886a16 req-deb563e4-014f-4021-adb9-48b85bd45cd6 service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f6c6518f-f7c3-4f78-83cb-d8fe75886a16 req-deb563e4-014f-4021-adb9-48b85bd45cd6 service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-f6c6518f-f7c3-4f78-83cb-d8fe75886a16 req-deb563e4-014f-4021-adb9-48b85bd45cd6 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] No waiting events found dispatching network-vif-unplugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:07:37 user nova-compute[75285]: WARNING nova.compute.manager [req-f6c6518f-f7c3-4f78-83cb-d8fe75886a16 req-deb563e4-014f-4021-adb9-48b85bd45cd6 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received unexpected event network-vif-unplugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e for instance with vm_state active and task_state rescuing.
Nov 10 21:07:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:38 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Instance destroyed successfully.
Nov 10 21:07:38 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Attempting rescue
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75285) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Instance directory exists: not creating {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 21:07:38 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Creating image(s)
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "/opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "/opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "/opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.objects.instance [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16f56b6b-f08d-4650-b0eb-a202662b0eb6 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.rescue {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.rescue" returned: 0 in 0.115s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.objects.instance [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'migration_context' on Instance uuid 16f56b6b-f08d-4650-b0eb-a202662b0eb6 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.objects.base [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<16f56b6b-f08d-4650-b0eb-a202662b0eb6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Start _get_guest_xml network_info=[{"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "vif_mac": "fa:16:3e:e9:4b:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.objects.instance [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'resources' on Instance uuid 16f56b6b-f08d-4650-b0eb-a202662b0eb6 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.objects.base [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<16f56b6b-f08d-4650-b0eb-a202662b0eb6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.objects.instance [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'numa_topology' on Instance uuid 16f56b6b-f08d-4650-b0eb-a202662b0eb6 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.objects.base [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<16f56b6b-f08d-4650-b0eb-a202662b0eb6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:07:38 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:07:38 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.objects.instance [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16f56b6b-f08d-4650-b0eb-a202662b0eb6 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.objects.base [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<16f56b6b-f08d-4650-b0eb-a202662b0eb6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1516474923',display_name='tempest-ServerRescueNegativeTestJSON-server-1516474923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1516474923',id=1,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:02:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44979c0f5b7d4205a0e5e0becbe714cb',ramdisk_id='',reservation_id='r-myu73inz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-418662944',owner_user_name='tempest-ServerRescueNegativeTestJSON-418662944-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:02:56Z,user_data=None,user_id='b9c20460877a428e9fa97869ba34eb04',uuid=16f56b6b-f08d-4650-b0eb-a202662b0eb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "vif_mac": "fa:16:3e:e9:4b:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converting VIF {"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "vif_mac": "fa:16:3e:e9:4b:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=9a01ec6d-d090-40da-bdbf-5bb60b90157e,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a01ec6d-d0') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.objects.instance [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'pci_devices' on Instance uuid 16f56b6b-f08d-4650-b0eb-a202662b0eb6 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.objects.base [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<16f56b6b-f08d-4650-b0eb-a202662b0eb6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:07:38 user nova-compute[75285]:   <uuid>16f56b6b-f08d-4650-b0eb-a202662b0eb6</uuid>
Nov 10 21:07:38 user nova-compute[75285]:   <name>instance-00000001</name>
Nov 10 21:07:38 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:07:38 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:07:38 user nova-compute[75285]:   <metadata>
Nov 10 21:07:38 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:07:38 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:07:38 user nova-compute[75285]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1516474923</nova:name>
Nov 10 21:07:38 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:07:38</nova:creationTime>
Nov 10 21:07:38 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:07:38 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:07:38 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:07:38 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:07:38 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:07:38 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:07:38 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:07:38 user nova-compute[75285]:       <nova:owner>
Nov 10 21:07:38 user nova-compute[75285]:         <nova:user uuid="b9c20460877a428e9fa97869ba34eb04">tempest-ServerRescueNegativeTestJSON-418662944-project-member</nova:user>
Nov 10 21:07:38 user nova-compute[75285]:         <nova:project uuid="44979c0f5b7d4205a0e5e0becbe714cb">tempest-ServerRescueNegativeTestJSON-418662944</nova:project>
Nov 10 21:07:38 user nova-compute[75285]:       </nova:owner>
Nov 10 21:07:38 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:07:38 user nova-compute[75285]:       <nova:ports>
Nov 10 21:07:38 user nova-compute[75285]:         <nova:port uuid="9a01ec6d-d090-40da-bdbf-5bb60b90157e">
Nov 10 21:07:38 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 21:07:38 user nova-compute[75285]:         </nova:port>
Nov 10 21:07:38 user nova-compute[75285]:       </nova:ports>
Nov 10 21:07:38 user nova-compute[75285]:     </nova:instance>
Nov 10 21:07:38 user nova-compute[75285]:   </metadata>
Nov 10 21:07:38 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:07:38 user nova-compute[75285]:     <system>
Nov 10 21:07:38 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:07:38 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:07:38 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:07:38 user nova-compute[75285]:       <entry name="serial">16f56b6b-f08d-4650-b0eb-a202662b0eb6</entry>
Nov 10 21:07:38 user nova-compute[75285]:       <entry name="uuid">16f56b6b-f08d-4650-b0eb-a202662b0eb6</entry>
Nov 10 21:07:38 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:07:38 user nova-compute[75285]:     </system>
Nov 10 21:07:38 user nova-compute[75285]:   </sysinfo>
Nov 10 21:07:38 user nova-compute[75285]:   <os>
Nov 10 21:07:38 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:07:38 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:07:38 user nova-compute[75285]:   </os>
Nov 10 21:07:38 user nova-compute[75285]:   <features>
Nov 10 21:07:38 user nova-compute[75285]:     <acpi/>
Nov 10 21:07:38 user nova-compute[75285]:     <apic/>
Nov 10 21:07:38 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:07:38 user nova-compute[75285]:   </features>
Nov 10 21:07:38 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:07:38 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:07:38 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:07:38 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:07:38 user nova-compute[75285]:   </clock>
Nov 10 21:07:38 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:07:38 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:07:38 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:07:38 user nova-compute[75285]:   </cpu>
Nov 10 21:07:38 user nova-compute[75285]:   <devices>
Nov 10 21:07:38 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:07:38 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:07:38 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.rescue"/>
Nov 10 21:07:38 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:07:38 user nova-compute[75285]:     </disk>
Nov 10 21:07:38 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:07:38 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:07:38 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk"/>
Nov 10 21:07:38 user nova-compute[75285]:       <target dev="vdb" bus="virtio"/>
Nov 10 21:07:38 user nova-compute[75285]:     </disk>
Nov 10 21:07:38 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:07:38 user nova-compute[75285]:       <mac address="fa:16:3e:e9:4b:33"/>
Nov 10 21:07:38 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:07:38 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:07:38 user nova-compute[75285]:       <target dev="tap9a01ec6d-d0"/>
Nov 10 21:07:38 user nova-compute[75285]:     </interface>
Nov 10 21:07:38 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:07:38 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/console.log" append="off"/>
Nov 10 21:07:38 user nova-compute[75285]:     </serial>
Nov 10 21:07:38 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:07:38 user nova-compute[75285]:     <video>
Nov 10 21:07:38 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:07:38 user nova-compute[75285]:     </video>
Nov 10 21:07:38 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:07:38 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:07:38 user nova-compute[75285]:     </rng>
Nov 10 21:07:38 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:07:38 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:07:38 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:07:38 user nova-compute[75285]:     </memballoon>
Nov 10 21:07:38 user nova-compute[75285]:   </devices>
Nov 10 21:07:38 user nova-compute[75285]: </domain>
Nov 10 21:07:38 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:07:38 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Instance destroyed successfully.
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No VIF found with MAC fa:16:3e:e9:4b:33, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Updating instance_info_cache with network_info: [{"id": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "address": "fa:16:3e:1f:23:b7", "network": {"id": "10f7fc99-7b04-4985-b19e-fb751f9b528c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1893985114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb80a67cb94284b19514d996fd0bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996db12a-8c", "ovs_interfaceid": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:38 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-454d15bc-c17a-498b-b6c8-5607a7f93c59 req-3d4c4344-8f26-4162-9221-c70251cb5e9a service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-454d15bc-c17a-498b-b6c8-5607a7f93c59 req-3d4c4344-8f26-4162-9221-c70251cb5e9a service nova] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-454d15bc-c17a-498b-b6c8-5607a7f93c59 req-3d4c4344-8f26-4162-9221-c70251cb5e9a service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-454d15bc-c17a-498b-b6c8-5607a7f93c59 req-3d4c4344-8f26-4162-9221-c70251cb5e9a service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-454d15bc-c17a-498b-b6c8-5607a7f93c59 req-3d4c4344-8f26-4162-9221-c70251cb5e9a service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] No waiting events found dispatching network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:07:40 user nova-compute[75285]: WARNING nova.compute.manager [req-454d15bc-c17a-498b-b6c8-5607a7f93c59 req-3d4c4344-8f26-4162-9221-c70251cb5e9a service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received unexpected event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e for instance with vm_state active and task_state rescuing.
Nov 10 21:07:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-454d15bc-c17a-498b-b6c8-5607a7f93c59 req-3d4c4344-8f26-4162-9221-c70251cb5e9a service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-454d15bc-c17a-498b-b6c8-5607a7f93c59 req-3d4c4344-8f26-4162-9221-c70251cb5e9a service nova] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-454d15bc-c17a-498b-b6c8-5607a7f93c59 req-3d4c4344-8f26-4162-9221-c70251cb5e9a service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-454d15bc-c17a-498b-b6c8-5607a7f93c59 req-3d4c4344-8f26-4162-9221-c70251cb5e9a service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-454d15bc-c17a-498b-b6c8-5607a7f93c59 req-3d4c4344-8f26-4162-9221-c70251cb5e9a service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] No waiting events found dispatching network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:07:40 user nova-compute[75285]: WARNING nova.compute.manager [req-454d15bc-c17a-498b-b6c8-5607a7f93c59 req-3d4c4344-8f26-4162-9221-c70251cb5e9a service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received unexpected event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e for instance with vm_state active and task_state rescuing.
Nov 10 21:07:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Acquiring lock "82a83f12-0822-4cd0-8d1b-3f939a601745" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Acquiring lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:41 user nova-compute[75285]: INFO nova.compute.manager [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Terminating instance
Nov 10 21:07:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-57acad89-b548-4b79-8daf-657ef84b3f7a req-3504a491-3c57-4248-9de1-c3f8d447ccbe service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Received event network-vif-unplugged-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-57acad89-b548-4b79-8daf-657ef84b3f7a req-3504a491-3c57-4248-9de1-c3f8d447ccbe service nova] Acquiring lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-57acad89-b548-4b79-8daf-657ef84b3f7a req-3504a491-3c57-4248-9de1-c3f8d447ccbe service nova] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-57acad89-b548-4b79-8daf-657ef84b3f7a req-3504a491-3c57-4248-9de1-c3f8d447ccbe service nova] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-57acad89-b548-4b79-8daf-657ef84b3f7a req-3504a491-3c57-4248-9de1-c3f8d447ccbe service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] No waiting events found dispatching network-vif-unplugged-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-57acad89-b548-4b79-8daf-657ef84b3f7a req-3504a491-3c57-4248-9de1-c3f8d447ccbe service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Received event network-vif-unplugged-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:07:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Instance destroyed successfully.
Nov 10 21:07:42 user nova-compute[75285]: DEBUG nova.objects.instance [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lazy-loading 'resources' on Instance uuid 82a83f12-0822-4cd0-8d1b-3f939a601745 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-156470612',display_name='tempest-VolumesAssistedSnapshotsTest-server-156470612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-156470612',id=8,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZAzmjNrd7tQKKYQ3OAqfkoDjKuI8a4Ydc/MOzQNOoyoDXSTpAtv/pgPStZjWIiVzrm8OmQjSluMw0gSH1lf6ci2dE/ki4CkwQjTrCU0mSybjqPjoYSZDNfH3/V3JjIWg==',key_name='tempest-keypair-1941044813',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:03:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e29618f896244f999368b8e855e865b',ramdisk_id='',reservation_id='r-yqm26z1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1283446631',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1283446631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3669c94227341edab384a4e1cb3020f',uuid=82a83f12-0822-4cd0-8d1b-3f939a601745,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "address": "fa:16:3e:44:22:16", "network": {"id": "a71f1ce1-f597-4e04-8039-515b9c112b34", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1988900701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e29618f896244f999368b8e855e865b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ffcbc-ca", "ovs_interfaceid": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Converting VIF {"id": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "address": "fa:16:3e:44:22:16", "network": {"id": "a71f1ce1-f597-4e04-8039-515b9c112b34", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1988900701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e29618f896244f999368b8e855e865b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f6ffcbc-ca", "ovs_interfaceid": "5f6ffcbc-caa3-42c2-b73a-06ee4a95946b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:22:16,bridge_name='br-int',has_traffic_filtering=True,id=5f6ffcbc-caa3-42c2-b73a-06ee4a95946b,network=Network(a71f1ce1-f597-4e04-8039-515b9c112b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6ffcbc-ca') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_vif [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:22:16,bridge_name='br-int',has_traffic_filtering=True,id=5f6ffcbc-caa3-42c2-b73a-06ee4a95946b,network=Network(a71f1ce1-f597-4e04-8039-515b9c112b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6ffcbc-ca') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f6ffcbc-ca, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c08aec26-ed27-4d6d-84cf-097b8a11623b) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:42 user nova-compute[75285]: INFO os_vif [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:22:16,bridge_name='br-int',has_traffic_filtering=True,id=5f6ffcbc-caa3-42c2-b73a-06ee4a95946b,network=Network(a71f1ce1-f597-4e04-8039-515b9c112b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f6ffcbc-ca')
Nov 10 21:07:42 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Deleting instance files /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745_del
Nov 10 21:07:42 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Deletion of /opt/stack/data/nova/instances/82a83f12-0822-4cd0-8d1b-3f939a601745_del complete
Nov 10 21:07:42 user nova-compute[75285]: DEBUG nova.compute.manager [req-9c901167-8530-4d0e-a454-9ba0ab502979 req-8e51bee6-d403-4300-ba36-06325375c1ba service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9c901167-8530-4d0e-a454-9ba0ab502979 req-8e51bee6-d403-4300-ba36-06325375c1ba service nova] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9c901167-8530-4d0e-a454-9ba0ab502979 req-8e51bee6-d403-4300-ba36-06325375c1ba service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9c901167-8530-4d0e-a454-9ba0ab502979 req-8e51bee6-d403-4300-ba36-06325375c1ba service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG nova.compute.manager [req-9c901167-8530-4d0e-a454-9ba0ab502979 req-8e51bee6-d403-4300-ba36-06325375c1ba service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] No waiting events found dispatching network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:07:42 user nova-compute[75285]: WARNING nova.compute.manager [req-9c901167-8530-4d0e-a454-9ba0ab502979 req-8e51bee6-d403-4300-ba36-06325375c1ba service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received unexpected event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e for instance with vm_state active and task_state rescuing.
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: INFO nova.compute.manager [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-754161e3-32df-4693-b0ea-6be5268b57a3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:07:42 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 is timed out.
Nov 10 21:07:42 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Successfully detached device vdb from instance 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 from the live domain config.
Nov 10 21:07:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZdEGvyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '7e4cfc71-aa34-4830-b7d4-c49ece3e3cec'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:07:42 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8da1f55-7338-49ab-a6e3-0dd455ae8b80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:07:42 user nova-compute[75285]: No targets found.
Nov 10 21:07:42 user nova-compute[75285]: iSNS:
Nov 10 21:07:42 user nova-compute[75285]: No targets found.
Nov 10 21:07:42 user nova-compute[75285]: STATIC:
Nov 10 21:07:42 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d
Nov 10 21:07:42 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:07:42 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:07:42 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec
Nov 10 21:07:42 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:07:42 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:07:42 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85
Nov 10 21:07:42 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:07:42 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:07:42 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89
Nov 10 21:07:42 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:07:42 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:07:42 user nova-compute[75285]: FIRMWARE:
Nov 10 21:07:42 user nova-compute[75285]: No targets found.
Nov 10 21:07:42 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:07:42 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:07:42 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ee11db-7bd0-4b49-a4b4-0a19a81c494f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb3b0f1-e101-4070-a9a5-2abf99d19ca2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:07:42 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:07:42 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:07:42 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:07:42 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec (non-flash)
Nov 10 21:07:42 user nova-compute[75285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:07:42 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:07:42 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:07:42 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a0427fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c783d33-cab8-49cf-8fac-ea7c9fa6ab80]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e239d8-350d-46a2-a90f-4eb8aa6d995c]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[577b9586-189c-4f48-8939-cbb583ab42b8]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.070s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[02472fd9-e45c-481c-ba67-58fb1ec87f77]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6462598e-a325-49d8-98e7-2d43f47a4589]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7277f0c7-34db-4318-a424-02366e49653c]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260]
Nov 10 21:07:42 user nova-compute[75285]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec, portal: 172.16.0.220,3260] successful.
Nov 10 21:07:42 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4cfc71-aa34-4830-b7d4-c49ece3e3cec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1b3147-61b0-477c-8f6f-be916557e511]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] <== disconnect_volume: return (433ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:07:43 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Took 1.23 seconds to deallocate network for instance.
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-b2da2b31-426f-4c4c-8710-67e63512c1f1 req-a90f9944-d134-4c87-8ea1-3e29ae456185 service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Received event network-vif-plugged-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b2da2b31-426f-4c4c-8710-67e63512c1f1 req-a90f9944-d134-4c87-8ea1-3e29ae456185 service nova] Acquiring lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b2da2b31-426f-4c4c-8710-67e63512c1f1 req-a90f9944-d134-4c87-8ea1-3e29ae456185 service nova] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b2da2b31-426f-4c4c-8710-67e63512c1f1 req-a90f9944-d134-4c87-8ea1-3e29ae456185 service nova] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-b2da2b31-426f-4c4c-8710-67e63512c1f1 req-a90f9944-d134-4c87-8ea1-3e29ae456185 service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] No waiting events found dispatching network-vif-plugged-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:07:43 user nova-compute[75285]: WARNING nova.compute.manager [req-b2da2b31-426f-4c4c-8710-67e63512c1f1 req-a90f9944-d134-4c87-8ea1-3e29ae456185 service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Received unexpected event network-vif-plugged-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b for instance with vm_state deleted and task_state None.
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:44 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:07:44 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:07:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.508s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:44 user nova-compute[75285]: DEBUG nova.objects.instance [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lazy-loading 'flavor' on Instance uuid 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:07:44 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Deleted allocations for instance 82a83f12-0822-4cd0-8d1b-3f939a601745
Nov 10 21:07:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9ace06cf-3d14-4161-b088-78477a7f397f tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.510s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:44 user nova-compute[75285]: DEBUG nova.compute.manager [req-fcefb088-5b01-4a7c-9c9f-6d87eb553323 req-85986697-a55e-416b-9237-c4628ea31fe3 service nova] [instance: 82a83f12-0822-4cd0-8d1b-3f939a601745] Received event network-vif-deleted-5f6ffcbc-caa3-42c2-b73a-06ee4a95946b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:07:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be04b188-5c56-42db-a303-7b05cb6a1308 tempest-VolumesAssistedSnapshotsTest-1283446631 tempest-VolumesAssistedSnapshotsTest-1283446631-project-member] Lock "82a83f12-0822-4cd0-8d1b-3f939a601745" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.218s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:07:45 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:07:45 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:07:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7685MB free_disk=25.45044708251953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 02b4446d-1538-4e80-b93d-5cb904b7b98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 6db680e7-3e21-4451-a0b1-29f9eca59b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance aa74d6a6-3084-45c9-b15a-2b831077a3ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance e5fd224c-b34e-41b6-9bdf-28c88579b88c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ceb3b8d9-56f2-46b8-bf25-7e898328ee6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:07:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:07:46 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:07:46 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:07:46 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:07:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:07:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:49 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:07:49 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:07:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:07:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-ae829ff1-02c7-4f0f-bad5-f4e952e5e80d req-ebb87d90-ae11-4fca-bf51-017318bb2307 service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Received event network-changed-53a2c401-3191-4153-94dc-a43a90457023 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-ae829ff1-02c7-4f0f-bad5-f4e952e5e80d req-ebb87d90-ae11-4fca-bf51-017318bb2307 service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Refreshing instance network info cache due to event network-changed-53a2c401-3191-4153-94dc-a43a90457023. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:08:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ae829ff1-02c7-4f0f-bad5-f4e952e5e80d req-ebb87d90-ae11-4fca-bf51-017318bb2307 service nova] Acquiring lock "refresh_cache-e5fd224c-b34e-41b6-9bdf-28c88579b88c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:08:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ae829ff1-02c7-4f0f-bad5-f4e952e5e80d req-ebb87d90-ae11-4fca-bf51-017318bb2307 service nova] Acquired lock "refresh_cache-e5fd224c-b34e-41b6-9bdf-28c88579b88c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:08:10 user nova-compute[75285]: DEBUG nova.network.neutron [req-ae829ff1-02c7-4f0f-bad5-f4e952e5e80d req-ebb87d90-ae11-4fca-bf51-017318bb2307 service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Refreshing network info cache for port 53a2c401-3191-4153-94dc-a43a90457023 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:08:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:11 user nova-compute[75285]: DEBUG nova.network.neutron [req-ae829ff1-02c7-4f0f-bad5-f4e952e5e80d req-ebb87d90-ae11-4fca-bf51-017318bb2307 service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Updated VIF entry in instance network info cache for port 53a2c401-3191-4153-94dc-a43a90457023. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:08:11 user nova-compute[75285]: DEBUG nova.network.neutron [req-ae829ff1-02c7-4f0f-bad5-f4e952e5e80d req-ebb87d90-ae11-4fca-bf51-017318bb2307 service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Updating instance_info_cache with network_info: [{"id": "53a2c401-3191-4153-94dc-a43a90457023", "address": "fa:16:3e:2a:72:ba", "network": {"id": "84709e26-9628-447a-8a3b-699ba6d9eb33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-411333431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e9d9d42834478695c751849a9a8639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a2c401-31", "ovs_interfaceid": "53a2c401-3191-4153-94dc-a43a90457023", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:08:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ae829ff1-02c7-4f0f-bad5-f4e952e5e80d req-ebb87d90-ae11-4fca-bf51-017318bb2307 service nova] Releasing lock "refresh_cache-e5fd224c-b34e-41b6-9bdf-28c88579b88c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:08:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:12 user nova-compute[75285]: INFO nova.compute.manager [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Terminating instance
Nov 10 21:08:12 user nova-compute[75285]: DEBUG nova.compute.manager [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:08:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-731c8dd0-5a65-4d0d-a000-5564ddcb8fac req-8e46fdbf-b1bf-47a0-9fb2-88c178e6913a service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received event network-vif-unplugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-731c8dd0-5a65-4d0d-a000-5564ddcb8fac req-8e46fdbf-b1bf-47a0-9fb2-88c178e6913a service nova] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-731c8dd0-5a65-4d0d-a000-5564ddcb8fac req-8e46fdbf-b1bf-47a0-9fb2-88c178e6913a service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-731c8dd0-5a65-4d0d-a000-5564ddcb8fac req-8e46fdbf-b1bf-47a0-9fb2-88c178e6913a service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-731c8dd0-5a65-4d0d-a000-5564ddcb8fac req-8e46fdbf-b1bf-47a0-9fb2-88c178e6913a service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] No waiting events found dispatching network-vif-unplugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-731c8dd0-5a65-4d0d-a000-5564ddcb8fac req-8e46fdbf-b1bf-47a0-9fb2-88c178e6913a service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received event network-vif-unplugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:13 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Instance destroyed successfully.
Nov 10 21:08:13 user nova-compute[75285]: DEBUG nova.objects.instance [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lazy-loading 'resources' on Instance uuid 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-989310564',display_name='tempest-TestVolumeSwap-server-989310564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-989310564',id=7,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFY5NNWOUGwA9ea1DnxPF3BGBncJ2wpHoqKPwpsPxQv8U3ZCURja7QkDTcPO5mzDJXaZBy6nyIwfISM/9koc1orS/qxoGk5nUBE70vuuXz+brj6jqF2nHLXDrslPOX2vQ==',key_name='tempest-keypair-691951150',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:03:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fbb80a67cb94284b19514d996fd0bb3',ramdisk_id='',reservation_id='r-o2ny1w52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-671625234',owner_user_name='tempest-TestVolumeSwap-671625234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='225156b687544aa98c6fd6d0e5ba7c38',uuid=8f6ad802-6f8f-42bc-95bd-934f4c9f55c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "address": "fa:16:3e:1f:23:b7", "network": {"id": "10f7fc99-7b04-4985-b19e-fb751f9b528c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1893985114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb80a67cb94284b19514d996fd0bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996db12a-8c", "ovs_interfaceid": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Converting VIF {"id": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "address": "fa:16:3e:1f:23:b7", "network": {"id": "10f7fc99-7b04-4985-b19e-fb751f9b528c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1893985114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb80a67cb94284b19514d996fd0bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap996db12a-8c", "ovs_interfaceid": "996db12a-8c23-4a7e-91f4-e0f87358b2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:23:b7,bridge_name='br-int',has_traffic_filtering=True,id=996db12a-8c23-4a7e-91f4-e0f87358b2a6,network=Network(10f7fc99-7b04-4985-b19e-fb751f9b528c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996db12a-8c') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG os_vif [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:23:b7,bridge_name='br-int',has_traffic_filtering=True,id=996db12a-8c23-4a7e-91f4-e0f87358b2a6,network=Network(10f7fc99-7b04-4985-b19e-fb751f9b528c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996db12a-8c') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap996db12a-8c, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4bd46a87-d314-4b49-925b-f87cfeeb0063) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:13 user nova-compute[75285]: INFO os_vif [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:23:b7,bridge_name='br-int',has_traffic_filtering=True,id=996db12a-8c23-4a7e-91f4-e0f87358b2a6,network=Network(10f7fc99-7b04-4985-b19e-fb751f9b528c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap996db12a-8c')
Nov 10 21:08:13 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Deleting instance files /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3_del
Nov 10 21:08:13 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Deletion of /opt/stack/data/nova/instances/8f6ad802-6f8f-42bc-95bd-934f4c9f55c3_del complete
Nov 10 21:08:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:13 user nova-compute[75285]: INFO nova.compute.manager [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 10 21:08:13 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:08:13 user nova-compute[75285]: INFO nova.compute.claims [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Claim successful on node user
Nov 10 21:08:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:14 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:08:14 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:08:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:08:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:08:14 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:08:14 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:08:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:08:14 user nova-compute[75285]: INFO nova.virt.block_device [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Booting with volume snapshot eef77498-5109-4917-af14-8d4a73dc36bc at /dev/vda
Nov 10 21:08:14 user nova-compute[75285]: DEBUG nova.policy [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e16c471c0875416aa0eb86d89eef3a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04636b8a9e404d40a3a2bc9f63a4df8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:08:14 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:08:14 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Took 1.35 seconds to deallocate network for instance.
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received event network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] No waiting events found dispatching network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:15 user nova-compute[75285]: WARNING nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received unexpected event network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 for instance with vm_state deleted and task_state None.
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-changed-99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing instance network info cache due to event network-changed-99435856-9d26-448e-87de-b0ca7e110d7e. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Acquiring lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Acquired lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.network.neutron [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Refreshing network info cache for port 99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:15 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Deleted allocations for instance 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-301c559f-b16f-40d3-a83c-a2e9469549bd tempest-TestVolumeSwap-671625234 tempest-TestVolumeSwap-671625234-project-member] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.074s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Successfully created port: 3dd04dae-2f80-4478-bfe4-e97bf0389700 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.network.neutron [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updated VIF entry in instance network info cache for port 99435856-9d26-448e-87de-b0ca7e110d7e. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.network.neutron [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updating instance_info_cache with network_info: [{"id": "99435856-9d26-448e-87de-b0ca7e110d7e", "address": "fa:16:3e:fe:af:16", "network": {"id": "50305b49-f0da-4a31-aa59-afec3d63b685", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2066917041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99435856-9d", "ovs_interfaceid": "99435856-9d26-448e-87de-b0ca7e110d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "address": "fa:16:3e:c9:0b:3c", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa285a3dc-41", "ovs_interfaceid": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "address": "fa:16:3e:17:7f:91", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007fd357-23", "ovs_interfaceid": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "address": "fa:16:3e:f3:38:05", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6c95f2-fe", "ovs_interfaceid": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "address": "fa:16:3e:41:2d:eb", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee974a9-ab", "ovs_interfaceid": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "address": "fa:16:3e:36:9a:af", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef2795ba-d5", "ovs_interfaceid": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "875dac5e-5dc7-45f9-befe-a128379298e1", "address": "fa:16:3e:98:b0:ab", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875dac5e-5d", "ovs_interfaceid": "875dac5e-5dc7-45f9-befe-a128379298e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Releasing lock "refresh_cache-aa74d6a6-3084-45c9-b15a-2b831077a3ac" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received event network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] No waiting events found dispatching network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:15 user nova-compute[75285]: WARNING nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received unexpected event network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 for instance with vm_state deleted and task_state None.
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received event network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] No waiting events found dispatching network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:15 user nova-compute[75285]: WARNING nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received unexpected event network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 for instance with vm_state deleted and task_state None.
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received event network-vif-unplugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] No waiting events found dispatching network-vif-unplugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:15 user nova-compute[75285]: WARNING nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received unexpected event network-vif-unplugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 for instance with vm_state deleted and task_state None.
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received event network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Acquiring lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] Lock "8f6ad802-6f8f-42bc-95bd-934f4c9f55c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] No waiting events found dispatching network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:15 user nova-compute[75285]: WARNING nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received unexpected event network-vif-plugged-996db12a-8c23-4a7e-91f4-e0f87358b2a6 for instance with vm_state deleted and task_state None.
Nov 10 21:08:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-13bd0df1-d5e7-4059-86dd-369eb2d9c1bb req-936d05bd-d6d1-40fc-8c32-db6c575c40c1 service nova] [instance: 8f6ad802-6f8f-42bc-95bd-934f4c9f55c3] Received event network-vif-deleted-996db12a-8c23-4a7e-91f4-e0f87358b2a6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Successfully updated port: 3dd04dae-2f80-4478-bfe4-e97bf0389700 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "refresh_cache-20cb91b5-2a74-4f99-adf9-0db04167d2e0" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquired lock "refresh_cache-20cb91b5-2a74-4f99-adf9-0db04167d2e0" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-91349f25-1a10-4d12-baa1-9ecddb3af60d req-bad7b253-2325-4445-b345-80d628ca516d service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Received event network-changed-3dd04dae-2f80-4478-bfe4-e97bf0389700 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-91349f25-1a10-4d12-baa1-9ecddb3af60d req-bad7b253-2325-4445-b345-80d628ca516d service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Refreshing instance network info cache due to event network-changed-3dd04dae-2f80-4478-bfe4-e97bf0389700. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-91349f25-1a10-4d12-baa1-9ecddb3af60d req-bad7b253-2325-4445-b345-80d628ca516d service nova] Acquiring lock "refresh_cache-20cb91b5-2a74-4f99-adf9-0db04167d2e0" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:16 user nova-compute[75285]: INFO nova.compute.manager [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Terminating instance
Nov 10 21:08:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Updating instance_info_cache with network_info: [{"id": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "address": "fa:16:3e:0a:41:02", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd04dae-2f", "ovs_interfaceid": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Releasing lock "refresh_cache-20cb91b5-2a74-4f99-adf9-0db04167d2e0" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Instance network_info: |[{"id": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "address": "fa:16:3e:0a:41:02", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd04dae-2f", "ovs_interfaceid": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-91349f25-1a10-4d12-baa1-9ecddb3af60d req-bad7b253-2325-4445-b345-80d628ca516d service nova] Acquired lock "refresh_cache-20cb91b5-2a74-4f99-adf9-0db04167d2e0" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG nova.network.neutron [req-91349f25-1a10-4d12-baa1-9ecddb3af60d req-bad7b253-2325-4445-b345-80d628ca516d service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Refreshing network info cache for port 3dd04dae-2f80-4478-bfe4-e97bf0389700 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:08:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-15b3b4fa-8d1b-4bb9-b07d-43a84e1de23a req-ab3b0966-f783-4270-8250-82f240a6b4ce service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-unplugged-99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-15b3b4fa-8d1b-4bb9-b07d-43a84e1de23a req-ab3b0966-f783-4270-8250-82f240a6b4ce service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-15b3b4fa-8d1b-4bb9-b07d-43a84e1de23a req-ab3b0966-f783-4270-8250-82f240a6b4ce service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-15b3b4fa-8d1b-4bb9-b07d-43a84e1de23a req-ab3b0966-f783-4270-8250-82f240a6b4ce service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-15b3b4fa-8d1b-4bb9-b07d-43a84e1de23a req-ab3b0966-f783-4270-8250-82f240a6b4ce service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-unplugged-99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-15b3b4fa-8d1b-4bb9-b07d-43a84e1de23a req-ab3b0966-f783-4270-8250-82f240a6b4ce service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-unplugged-99435856-9d26-448e-87de-b0ca7e110d7e for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-33e34c20-5d64-415d-8804-31aa21029a64 req-7fa41dca-d590-4fdf-ad49-16562c7c8819 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-unplugged-a285a3dc-41b1-41f5-8f7f-693f74e288ad {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-33e34c20-5d64-415d-8804-31aa21029a64 req-7fa41dca-d590-4fdf-ad49-16562c7c8819 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-33e34c20-5d64-415d-8804-31aa21029a64 req-7fa41dca-d590-4fdf-ad49-16562c7c8819 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-33e34c20-5d64-415d-8804-31aa21029a64 req-7fa41dca-d590-4fdf-ad49-16562c7c8819 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-33e34c20-5d64-415d-8804-31aa21029a64 req-7fa41dca-d590-4fdf-ad49-16562c7c8819 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-unplugged-a285a3dc-41b1-41f5-8f7f-693f74e288ad {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-33e34c20-5d64-415d-8804-31aa21029a64 req-7fa41dca-d590-4fdf-ad49-16562c7c8819 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-unplugged-a285a3dc-41b1-41f5-8f7f-693f74e288ad for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG nova.network.neutron [req-91349f25-1a10-4d12-baa1-9ecddb3af60d req-bad7b253-2325-4445-b345-80d628ca516d service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Updated VIF entry in instance network info cache for port 3dd04dae-2f80-4478-bfe4-e97bf0389700. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG nova.network.neutron [req-91349f25-1a10-4d12-baa1-9ecddb3af60d req-bad7b253-2325-4445-b345-80d628ca516d service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Updating instance_info_cache with network_info: [{"id": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "address": "fa:16:3e:0a:41:02", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd04dae-2f", "ovs_interfaceid": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-91349f25-1a10-4d12-baa1-9ecddb3af60d req-bad7b253-2325-4445-b345-80d628ca516d service nova] Releasing lock "refresh_cache-20cb91b5-2a74-4f99-adf9-0db04167d2e0" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.objects.instance [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lazy-loading 'flavor' on Instance uuid e5fd224c-b34e-41b6-9bdf-28c88579b88c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:18 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Instance destroyed successfully.
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.objects.instance [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lazy-loading 'resources' on Instance uuid aa74d6a6-3084-45c9-b15a-2b831077a3ac {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:06:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99435856-9d26-448e-87de-b0ca7e110d7e", "address": "fa:16:3e:fe:af:16", "network": {"id": "50305b49-f0da-4a31-aa59-afec3d63b685", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2066917041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99435856-9d", "ovs_interfaceid": "99435856-9d26-448e-87de-b0ca7e110d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "99435856-9d26-448e-87de-b0ca7e110d7e", "address": "fa:16:3e:fe:af:16", "network": {"id": "50305b49-f0da-4a31-aa59-afec3d63b685", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2066917041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99435856-9d", "ovs_interfaceid": "99435856-9d26-448e-87de-b0ca7e110d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:af:16,bridge_name='br-int',has_traffic_filtering=True,id=99435856-9d26-448e-87de-b0ca7e110d7e,network=Network(50305b49-f0da-4a31-aa59-afec3d63b685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99435856-9d') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG os_vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:af:16,bridge_name='br-int',has_traffic_filtering=True,id=99435856-9d26-448e-87de-b0ca7e110d7e,network=Network(50305b49-f0da-4a31-aa59-afec3d63b685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99435856-9d') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99435856-9d, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.compute.manager [req-5a870945-3ae2-4208-b3b9-88637dcb5868 req-8a68595c-1dc1-4b30-8a58-1289c9f6b47f service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-unplugged-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5a870945-3ae2-4208-b3b9-88637dcb5868 req-8a68595c-1dc1-4b30-8a58-1289c9f6b47f service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5a870945-3ae2-4208-b3b9-88637dcb5868 req-8a68595c-1dc1-4b30-8a58-1289c9f6b47f service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5a870945-3ae2-4208-b3b9-88637dcb5868 req-8a68595c-1dc1-4b30-8a58-1289c9f6b47f service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.compute.manager [req-5a870945-3ae2-4208-b3b9-88637dcb5868 req-8a68595c-1dc1-4b30-8a58-1289c9f6b47f service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-unplugged-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.compute.manager [req-5a870945-3ae2-4208-b3b9-88637dcb5868 req-8a68595c-1dc1-4b30-8a58-1289c9f6b47f service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-unplugged-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.compute.manager [req-5a870945-3ae2-4208-b3b9-88637dcb5868 req-8a68595c-1dc1-4b30-8a58-1289c9f6b47f service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5a870945-3ae2-4208-b3b9-88637dcb5868 req-8a68595c-1dc1-4b30-8a58-1289c9f6b47f service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5a870945-3ae2-4208-b3b9-88637dcb5868 req-8a68595c-1dc1-4b30-8a58-1289c9f6b47f service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5a870945-3ae2-4208-b3b9-88637dcb5868 req-8a68595c-1dc1-4b30-8a58-1289c9f6b47f service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.compute.manager [req-5a870945-3ae2-4208-b3b9-88637dcb5868 req-8a68595c-1dc1-4b30-8a58-1289c9f6b47f service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:18 user nova-compute[75285]: WARNING nova.compute.manager [req-5a870945-3ae2-4208-b3b9-88637dcb5868 req-8a68595c-1dc1-4b30-8a58-1289c9f6b47f service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d for instance with vm_state active and task_state deleting.
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ab4bddc-98f1-4f44-9f62-bb9c9ad7c583) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:18 user nova-compute[75285]: INFO nova.compute.manager [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Attaching volume 8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 to /dev/vdb
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: INFO os_vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:af:16,bridge_name='br-int',has_traffic_filtering=True,id=99435856-9d26-448e-87de-b0ca7e110d7e,network=Network(50305b49-f0da-4a31-aa59-afec3d63b685),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99435856-9d')
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:06:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "address": "fa:16:3e:c9:0b:3c", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa285a3dc-41", "ovs_interfaceid": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "address": "fa:16:3e:c9:0b:3c", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa285a3dc-41", "ovs_interfaceid": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0b:3c,bridge_name='br-int',has_traffic_filtering=True,id=a285a3dc-41b1-41f5-8f7f-693f74e288ad,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa285a3dc-41') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG os_vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0b:3c,bridge_name='br-int',has_traffic_filtering=True,id=a285a3dc-41b1-41f5-8f7f-693f74e288ad,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa285a3dc-41') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa285a3dc-41, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=782c2c3c-d748-4070-902e-40537715a8fa) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG os_brick.utils [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd96e4d-ca65-4ecb-8bbc-f82c46888bba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3017bfa1-fb1a-45a8-b263-b91acb1ab434]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:18 user nova-compute[75285]: INFO os_vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0b:3c,bridge_name='br-int',has_traffic_filtering=True,id=a285a3dc-41b1-41f5-8f7f-693f74e288ad,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa285a3dc-41')
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:06:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "address": "fa:16:3e:17:7f:91", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007fd357-23", "ovs_interfaceid": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "address": "fa:16:3e:17:7f:91", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007fd357-23", "ovs_interfaceid": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:7f:91,bridge_name='br-int',has_traffic_filtering=True,id=007fd357-2314-47ad-9e02-0e30f5e6dd09,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap007fd357-23') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG os_vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:7f:91,bridge_name='br-int',has_traffic_filtering=True,id=007fd357-2314-47ad-9e02-0e30f5e6dd09,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap007fd357-23') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap007fd357-23, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4ff0c5-6895-4d05-8d02-79fca70f1cec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[838ee7cc-e883-48a4-afb1-4b4beda24ee0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e5d3530-500d-4d82-bbb3-425059630b2c) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:08:19 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[22af6c57-1574-4300-8384-26cd018a3e9f]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.utils [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Updating existing volume attachment record: 48af2b79-ffea-49d7-824b-a0184ece1117 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: INFO os_vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:7f:91,bridge_name='br-int',has_traffic_filtering=True,id=007fd357-2314-47ad-9e02-0e30f5e6dd09,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap007fd357-23')
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:06:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "address": "fa:16:3e:f3:38:05", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6c95f2-fe", "ovs_interfaceid": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "address": "fa:16:3e:f3:38:05", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb6c95f2-fe", "ovs_interfaceid": "fb6c95f2-fe2f-488b-8119-6cc8158f90a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:38:05,bridge_name='br-int',has_traffic_filtering=True,id=fb6c95f2-fe2f-488b-8119-6cc8158f90a5,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6c95f2-fe') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:38:05,bridge_name='br-int',has_traffic_filtering=True,id=fb6c95f2-fe2f-488b-8119-6cc8158f90a5,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6c95f2-fe') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb6c95f2-fe, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1803c779-8a27-4645-a63c-2543f9cb7008) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: INFO os_vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:38:05,bridge_name='br-int',has_traffic_filtering=True,id=fb6c95f2-fe2f-488b-8119-6cc8158f90a5,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb6c95f2-fe')
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:06:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "address": "fa:16:3e:41:2d:eb", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee974a9-ab", "ovs_interfaceid": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "address": "fa:16:3e:41:2d:eb", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee974a9-ab", "ovs_interfaceid": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:2d:eb,bridge_name='br-int',has_traffic_filtering=True,id=3ee974a9-ab23-4c8b-99c3-3e0823cccfaf,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee974a9-ab') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:2d:eb,bridge_name='br-int',has_traffic_filtering=True,id=3ee974a9-ab23-4c8b-99c3-3e0823cccfaf,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee974a9-ab') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ee974a9-ab, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d00b95a7-01ee-4c74-9fe2-e6d70280e54a) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: INFO os_vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:2d:eb,bridge_name='br-int',has_traffic_filtering=True,id=3ee974a9-ab23-4c8b-99c3-3e0823cccfaf,network=Network(7fe71e93-1351-4984-9ed2-8191d032d375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ee974a9-ab')
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:06:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "address": "fa:16:3e:36:9a:af", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef2795ba-d5", "ovs_interfaceid": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "address": "fa:16:3e:36:9a:af", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef2795ba-d5", "ovs_interfaceid": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9a:af,bridge_name='br-int',has_traffic_filtering=True,id=ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d,network=Network(6746c947-a1e1-44d7-94c8-69098fb5fce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef2795ba-d5') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9a:af,bridge_name='br-int',has_traffic_filtering=True,id=ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d,network=Network(6746c947-a1e1-44d7-94c8-69098fb5fce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef2795ba-d5') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef2795ba-d5, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cfeb73e-9004-4973-9a40-48ec311a4c42) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: INFO os_vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9a:af,bridge_name='br-int',has_traffic_filtering=True,id=ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d,network=Network(6746c947-a1e1-44d7-94c8-69098fb5fce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef2795ba-d5')
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-799322528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-799322528',id=9,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDEYc7S0dGPEPzRFIBix0j2UZhEtCL54M7UcZVYCObb2ArWS51aKoBR1cNYi0LO5wy41sVXkW1p0QpvO22Xn6EvFUOqAdHCznT1vBoOYr6JepTHh0YqQjjIniZ62ujAiA==',key_name='tempest-keypair-1339591724',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:06:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d8ea660e66943cca0d07c83d14612c7',ramdisk_id='',reservation_id='r-phyywcup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-280000780',owner_user_name='tempest-TaggedBootDevicesTest_v242-280000780-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14517e31ebb14b2aa08eaa4c7903cf75',uuid=aa74d6a6-3084-45c9-b15a-2b831077a3ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "875dac5e-5dc7-45f9-befe-a128379298e1", "address": "fa:16:3e:98:b0:ab", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875dac5e-5d", "ovs_interfaceid": "875dac5e-5dc7-45f9-befe-a128379298e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converting VIF {"id": "875dac5e-5dc7-45f9-befe-a128379298e1", "address": "fa:16:3e:98:b0:ab", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875dac5e-5d", "ovs_interfaceid": "875dac5e-5dc7-45f9-befe-a128379298e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b0:ab,bridge_name='br-int',has_traffic_filtering=True,id=875dac5e-5dc7-45f9-befe-a128379298e1,network=Network(6746c947-a1e1-44d7-94c8-69098fb5fce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875dac5e-5d') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b0:ab,bridge_name='br-int',has_traffic_filtering=True,id=875dac5e-5dc7-45f9-befe-a128379298e1,network=Network(6746c947-a1e1-44d7-94c8-69098fb5fce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875dac5e-5d') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap875dac5e-5d, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fad8cc5-a50b-4ceb-952a-4c2906b9cd42) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:19 user nova-compute[75285]: INFO os_vif [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b0:ab,bridge_name='br-int',has_traffic_filtering=True,id=875dac5e-5dc7-45f9-befe-a128379298e1,network=Network(6746c947-a1e1-44d7-94c8-69098fb5fce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875dac5e-5d')
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPHsZqJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:08:19 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafd21bc-e263-4fb8-9388-b273093e69b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:08:19 user nova-compute[75285]: No targets found.
Nov 10 21:08:19 user nova-compute[75285]: iSNS:
Nov 10 21:08:19 user nova-compute[75285]: No targets found.
Nov 10 21:08:19 user nova-compute[75285]: STATIC:
Nov 10 21:08:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d
Nov 10 21:08:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:08:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:08:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85
Nov 10 21:08:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:08:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:08:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89
Nov 10 21:08:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:08:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:08:19 user nova-compute[75285]: FIRMWARE:
Nov 10 21:08:19 user nova-compute[75285]: No targets found.
Nov 10 21:08:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:08:19 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:08:19 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dd2468-0374-409f-aea4-b5bc599798d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa9ca01-15ca-476d-932f-03cf7fbc652a]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:08:19 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:08:19 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:08:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 (non-flash)
Nov 10 21:08:19 user nova-compute[75285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:08:19 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:08:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e468ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89'): ({'sdf'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Removing single pathed devices sdf {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f3dfb7-db70-4449-bba1-b5bd597b3a78]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9693bb-96f0-4fa5-8ae4-dc4718da5ad9]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Flushing IO for device /dev/sdf {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:19 user nova-compute[75285]: WARNING nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-99435856-9d26-448e-87de-b0ca7e110d7e for instance with vm_state active and task_state deleting.
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-unplugged-007fd357-2314-47ad-9e02-0e30f5e6dd09 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-unplugged-007fd357-2314-47ad-9e02-0e30f5e6dd09 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-unplugged-007fd357-2314-47ad-9e02-0e30f5e6dd09 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-007fd357-2314-47ad-9e02-0e30f5e6dd09 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-007fd357-2314-47ad-9e02-0e30f5e6dd09 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:19 user nova-compute[75285]: WARNING nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-007fd357-2314-47ad-9e02-0e30f5e6dd09 for instance with vm_state active and task_state deleting.
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-unplugged-fb6c95f2-fe2f-488b-8119-6cc8158f90a5 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-unplugged-fb6c95f2-fe2f-488b-8119-6cc8158f90a5 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-unplugged-fb6c95f2-fe2f-488b-8119-6cc8158f90a5 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-fb6c95f2-fe2f-488b-8119-6cc8158f90a5 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-fb6c95f2-fe2f-488b-8119-6cc8158f90a5 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:19 user nova-compute[75285]: WARNING nova.compute.manager [req-80a8ff41-b393-4908-88e5-39bcfcaf935a req-80474dbe-8de7-40b1-8394-9119087a84e3 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-fb6c95f2-fe2f-488b-8119-6cc8158f90a5 for instance with vm_state active and task_state deleting.
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b03f20-ed8e-4ae4-8aa1-098336de41df]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc91013-4ff9-49df-96c4-65e45d357a6a]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] SCSI volumes sdf have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3b2c28-52f1-4ba6-b919-46ccc96c43f9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb31491c-5a54-4799-b017-5f5e06c43508]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89, portal: 172.16.0.220,3260]
Nov 10 21:08:19 user nova-compute[75285]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89, portal: 172.16.0.220,3260] successful.
Nov 10 21:08:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eae897f-a431-47f8-a064-f82680de5b89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aabe196-d003-4125-9e0b-e2866e6a89f3]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] <== disconnect_volume: return (353ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgoNPUdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:08:19 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8bf1f7-1375-4c57-8a07-86cd9a9737cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:08:19 user nova-compute[75285]: No targets found.
Nov 10 21:08:19 user nova-compute[75285]: iSNS:
Nov 10 21:08:19 user nova-compute[75285]: No targets found.
Nov 10 21:08:19 user nova-compute[75285]: STATIC:
Nov 10 21:08:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d
Nov 10 21:08:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:08:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:08:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85
Nov 10 21:08:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:08:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:08:19 user nova-compute[75285]: FIRMWARE:
Nov 10 21:08:19 user nova-compute[75285]: No targets found.
Nov 10 21:08:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:08:19 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:08:19 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5ad9a2-9b9c-4238-92d4-384b85e9713e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a96e5e9-f579-47ad-bded-aba91a2fc125]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:08:19 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:08:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d (non-flash)
Nov 10 21:08:19 user nova-compute[75285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:08:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e468ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d'): ({'sdg'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Removing single pathed devices sdg {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6308dca4-45eb-4b27-b5eb-f2d20d86f5ac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4622aa56-e810-4924-bd6f-74eea71554ab]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Flushing IO for device /dev/sdg {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfdeed5-149e-48f6-82fe-a643fdc5820a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-a285a3dc-41b1-41f5-8f7f-693f74e288ad {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-a285a3dc-41b1-41f5-8f7f-693f74e288ad {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:19 user nova-compute[75285]: WARNING nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-a285a3dc-41b1-41f5-8f7f-693f74e288ad for instance with vm_state active and task_state deleting.
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-unplugged-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-unplugged-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-unplugged-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:19 user nova-compute[75285]: WARNING nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf for instance with vm_state active and task_state deleting.
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-unplugged-875dac5e-5dc7-45f9-befe-a128379298e1 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-unplugged-875dac5e-5dc7-45f9-befe-a128379298e1 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-unplugged-875dac5e-5dc7-45f9-befe-a128379298e1 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-plugged-875dac5e-5dc7-45f9-befe-a128379298e1 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] No waiting events found dispatching network-vif-plugged-875dac5e-5dc7-45f9-befe-a128379298e1 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:19 user nova-compute[75285]: WARNING nova.compute.manager [req-1d9c4610-952d-440c-b976-56f54361b77a req-29c18c4f-5744-434e-9e94-47e24d7bc622 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received unexpected event network-vif-plugged-875dac5e-5dc7-45f9-befe-a128379298e1 for instance with vm_state active and task_state deleting.
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[329fb1f3-d22e-453d-b45a-83faf5513342]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] SCSI volumes sdg have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc53991b-eed3-4dcd-af38-26286e57a4af]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aec705-423e-4621-897a-a2b8218d0f45]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d, portal: 172.16.0.220,3260]
Nov 10 21:08:19 user nova-compute[75285]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d, portal: 172.16.0.220,3260] successful.
Nov 10 21:08:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:08:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7ed375-8c35-4522-8f63-bcdf78c5ca8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eadc7f1-8b8c-40d6-807d-a5939910a73e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] <== disconnect_volume: return (316ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDEOnSoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:08:20 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd21f9be-cea4-4f44-999b-4e08a4b92c1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:08:20 user nova-compute[75285]: No targets found.
Nov 10 21:08:20 user nova-compute[75285]: iSNS:
Nov 10 21:08:20 user nova-compute[75285]: No targets found.
Nov 10 21:08:20 user nova-compute[75285]: STATIC:
Nov 10 21:08:20 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85
Nov 10 21:08:20 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:08:20 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:08:20 user nova-compute[75285]: FIRMWARE:
Nov 10 21:08:20 user nova-compute[75285]: No targets found.
Nov 10 21:08:20 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:08:20 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:08:20 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[775d4645-f61f-4fe2-a9ac-3f42d2639bbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[68914ccd-9a7c-492a-b90d-456748658bd5]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:08:20 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 (non-flash)
Nov 10 21:08:20 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e468ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85'): ({'sdh'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Removing single pathed devices sdh {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0cc761-3bd4-44d7-91cd-9fa243f732d1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff45253f-8c19-4394-9cdd-d5e644ef5b25]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Flushing IO for device /dev/sdh {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67f7b1e-fbfb-4c5b-baf6-baa22a4be31e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ceb10c2-30d8-4e5d-a650-0c6df36be769]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] SCSI volumes sdh have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdf386b-6870-4165-ae6d-78795f476c1b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[514a631d-5c86-4b6b-9b3b-26aa8de9e2ac]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85, portal: 172.16.0.220,3260]
Nov 10 21:08:20 user nova-compute[75285]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85, portal: 172.16.0.220,3260] successful.
Nov 10 21:08:20 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c74ae0-495c-4359-aef0-ebd1c41a5b85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.178s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeec714f-8112-4b46-927a-7a4e6b9a752e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.491s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] <== disconnect_volume: return (493ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:08:20 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Deleting instance files /opt/stack/data/nova/instances/aa74d6a6-3084-45c9-b15a-2b831077a3ac_del
Nov 10 21:08:20 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Deletion of /opt/stack/data/nova/instances/aa74d6a6-3084-45c9-b15a-2b831077a3ac_del complete
Nov 10 21:08:20 user nova-compute[75285]: INFO nova.compute.manager [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Took 3.71 seconds to destroy the instance on the hypervisor.
Nov 10 21:08:20 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:08:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-53b235b2-b96a-4b03-8d33-f943851c0176 req-f464f57d-1bd5-47bf-8202-12445ebf5079 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-deleted-fb6c95f2-fe2f-488b-8119-6cc8158f90a5 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:22 user nova-compute[75285]: INFO nova.compute.manager [req-53b235b2-b96a-4b03-8d33-f943851c0176 req-f464f57d-1bd5-47bf-8202-12445ebf5079 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Neutron deleted interface fb6c95f2-fe2f-488b-8119-6cc8158f90a5; detaching it from the instance and deleting it from the info cache
Nov 10 21:08:22 user nova-compute[75285]: DEBUG nova.network.neutron [req-53b235b2-b96a-4b03-8d33-f943851c0176 req-f464f57d-1bd5-47bf-8202-12445ebf5079 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updating instance_info_cache with network_info: [{"id": "99435856-9d26-448e-87de-b0ca7e110d7e", "address": "fa:16:3e:fe:af:16", "network": {"id": "50305b49-f0da-4a31-aa59-afec3d63b685", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2066917041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99435856-9d", "ovs_interfaceid": "99435856-9d26-448e-87de-b0ca7e110d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "address": "fa:16:3e:c9:0b:3c", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa285a3dc-41", "ovs_interfaceid": "a285a3dc-41b1-41f5-8f7f-693f74e288ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "address": "fa:16:3e:17:7f:91", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007fd357-23", "ovs_interfaceid": "007fd357-2314-47ad-9e02-0e30f5e6dd09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "address": "fa:16:3e:41:2d:eb", "network": {"id": "7fe71e93-1351-4984-9ed2-8191d032d375", "bridge": "br-int", "label": "tempest-device-tagging-net1-349073490", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ee974a9-ab", "ovs_interfaceid": "3ee974a9-ab23-4c8b-99c3-3e0823cccfaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "address": "fa:16:3e:36:9a:af", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef2795ba-d5", "ovs_interfaceid": "ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "875dac5e-5dc7-45f9-befe-a128379298e1", "address": "fa:16:3e:98:b0:ab", "network": {"id": "6746c947-a1e1-44d7-94c8-69098fb5fce9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1752985840", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5d8ea660e66943cca0d07c83d14612c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875dac5e-5d", "ovs_interfaceid": "875dac5e-5dc7-45f9-befe-a128379298e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:08:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-53b235b2-b96a-4b03-8d33-f943851c0176 req-f464f57d-1bd5-47bf-8202-12445ebf5079 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Detach interface failed, port_id=fb6c95f2-fe2f-488b-8119-6cc8158f90a5, reason: Instance aa74d6a6-3084-45c9-b15a-2b831077a3ac could not be found. {{(pid=75285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 21:08:24 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:08:24 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Took 3.61 seconds to deallocate network for instance.
Nov 10 21:08:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-0c7921c0-fe53-477d-bd10-583eb222fd24 req-93cf67d6-a996-49be-9b82-f1d9202da5c0 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-deleted-99435856-9d26-448e-87de-b0ca7e110d7e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-0c7921c0-fe53-477d-bd10-583eb222fd24 req-93cf67d6-a996-49be-9b82-f1d9202da5c0 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-deleted-875dac5e-5dc7-45f9-befe-a128379298e1 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-0c7921c0-fe53-477d-bd10-583eb222fd24 req-93cf67d6-a996-49be-9b82-f1d9202da5c0 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-deleted-3ee974a9-ab23-4c8b-99c3-3e0823cccfaf {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-0c7921c0-fe53-477d-bd10-583eb222fd24 req-93cf67d6-a996-49be-9b82-f1d9202da5c0 service nova] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Received event network-vif-deleted-ef2795ba-d5d3-4a4f-9b66-f3ac4d0e2d8d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:34 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:08:34 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:08:35 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:08:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:36 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:08:36 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:08:36 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:08:36 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances with incomplete migration  {{(pid=75285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 21:08:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:37 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:08:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:08:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Didn't find any instances for network info cache update. {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 21:08:38 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:08:38 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:08:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 21:08:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] There are 0 instances to clean {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 21:08:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:39 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:08:39 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:08:39 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:08:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:39 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:08:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG os_brick.utils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bc15eb-971b-41dc-be5b-b4a27f246cb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[437a076d-e5ce-4db9-a7a9-cd6a1df147b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b499545-99e2-4a56-b00f-de321c8b3af5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb54fdcf-2304-451d-a807-89ecb66ebcf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:08:40 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:08:40 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9a1ac5-21f9-4b65-9515-b1d234ab8259]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG os_brick.utils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:08:40 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Updating existing volume attachment record: be633795-f961-428d-b67a-8437a4d652cc {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:08:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:43 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:08:43 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:08:43 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8061MB free_disk=25.490921020507812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:08:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 02b4446d-1538-4e80-b93d-5cb904b7b98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 6db680e7-3e21-4451-a0b1-29f9eca59b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance aa74d6a6-3084-45c9-b15a-2b831077a3ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance e5fd224c-b34e-41b6-9bdf-28c88579b88c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ceb3b8d9-56f2-46b8-bf25-7e898328ee6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 20cb91b5-2a74-4f99-adf9-0db04167d2e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing inventories for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating ProviderTree inventory for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating inventory in ProviderTree for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing aggregate associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, aggregates: None {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing trait associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:08:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.816s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:48 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:08:48 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:08:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:52 user nova-compute[75285]: DEBUG nova.compute.manager [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:08:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:08:52 user nova-compute[75285]: INFO nova.compute.claims [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Claim successful on node user
Nov 10 21:08:53 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG nova.compute.manager [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG nova.compute.manager [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG nova.network.neutron [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:08:53 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:08:53 user nova-compute[75285]: DEBUG nova.compute.manager [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG nova.policy [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac13c724170f47368e5a395110c631b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9957f55c59044088e94338564e04092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG nova.compute.manager [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:08:53 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Creating image(s)
Nov 10 21:08:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "/opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "/opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "/opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.169s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.190s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk 1073741824" returned: 0 in 0.054s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG nova.network.neutron [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Successfully created port: e351ba01-6d16-40ea-ae88-097b9756cc70 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Cannot resize image /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Ensure instance console log exists: /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG nova.network.neutron [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Successfully updated port: e351ba01-6d16-40ea-ae88-097b9756cc70 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquired lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG nova.network.neutron [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG nova.compute.manager [req-e474341b-7eff-4489-b7ab-b8359fcaf3d9 req-96a7586a-2893-4aad-8acd-dd80e23d4277 service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Received event network-changed-e351ba01-6d16-40ea-ae88-097b9756cc70 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG nova.compute.manager [req-e474341b-7eff-4489-b7ab-b8359fcaf3d9 req-96a7586a-2893-4aad-8acd-dd80e23d4277 service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Refreshing instance network info cache due to event network-changed-e351ba01-6d16-40ea-ae88-097b9756cc70. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:08:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e474341b-7eff-4489-b7ab-b8359fcaf3d9 req-96a7586a-2893-4aad-8acd-dd80e23d4277 service nova] Acquiring lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.network.neutron [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.network.neutron [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Updating instance_info_cache with network_info: [{"id": "e351ba01-6d16-40ea-ae88-097b9756cc70", "address": "fa:16:3e:a6:48:80", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape351ba01-6d", "ovs_interfaceid": "e351ba01-6d16-40ea-ae88-097b9756cc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Releasing lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Instance network_info: |[{"id": "e351ba01-6d16-40ea-ae88-097b9756cc70", "address": "fa:16:3e:a6:48:80", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape351ba01-6d", "ovs_interfaceid": "e351ba01-6d16-40ea-ae88-097b9756cc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e474341b-7eff-4489-b7ab-b8359fcaf3d9 req-96a7586a-2893-4aad-8acd-dd80e23d4277 service nova] Acquired lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.network.neutron [req-e474341b-7eff-4489-b7ab-b8359fcaf3d9 req-96a7586a-2893-4aad-8acd-dd80e23d4277 service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Refreshing network info cache for port e351ba01-6d16-40ea-ae88-097b9756cc70 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Start _get_guest_xml network_info=[{"id": "e351ba01-6d16-40ea-ae88-097b9756cc70", "address": "fa:16:3e:a6:48:80", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape351ba01-6d", "ovs_interfaceid": "e351ba01-6d16-40ea-ae88-097b9756cc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:08:55 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:08:55 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:08:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1960528635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1960528635',id=14,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9957f55c59044088e94338564e04092',ramdisk_id='',reservation_id='r-wc9q91fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-396261753',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:08:54Z,user_data=None,user_id='ac13c724170f47368e5a395110c631b7',uuid=32d2946b-f299-4b62-9f3b-6c00b0b8858b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e351ba01-6d16-40ea-ae88-097b9756cc70", "address": "fa:16:3e:a6:48:80", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape351ba01-6d", "ovs_interfaceid": "e351ba01-6d16-40ea-ae88-097b9756cc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converting VIF {"id": "e351ba01-6d16-40ea-ae88-097b9756cc70", "address": "fa:16:3e:a6:48:80", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape351ba01-6d", "ovs_interfaceid": "e351ba01-6d16-40ea-ae88-097b9756cc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e351ba01-6d16-40ea-ae88-097b9756cc70,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape351ba01-6d') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.objects.instance [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'pci_devices' on Instance uuid 32d2946b-f299-4b62-9f3b-6c00b0b8858b {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:08:55 user nova-compute[75285]:   <uuid>32d2946b-f299-4b62-9f3b-6c00b0b8858b</uuid>
Nov 10 21:08:55 user nova-compute[75285]:   <name>instance-0000000e</name>
Nov 10 21:08:55 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:08:55 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:08:55 user nova-compute[75285]:   <metadata>
Nov 10 21:08:55 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:08:55 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:08:55 user nova-compute[75285]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1960528635</nova:name>
Nov 10 21:08:55 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:08:55</nova:creationTime>
Nov 10 21:08:55 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:08:55 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:08:55 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:08:55 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:08:55 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:08:55 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:08:55 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:08:55 user nova-compute[75285]:       <nova:owner>
Nov 10 21:08:55 user nova-compute[75285]:         <nova:user uuid="ac13c724170f47368e5a395110c631b7">tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member</nova:user>
Nov 10 21:08:55 user nova-compute[75285]:         <nova:project uuid="b9957f55c59044088e94338564e04092">tempest-ServerBootFromVolumeStableRescueTest-396261753</nova:project>
Nov 10 21:08:55 user nova-compute[75285]:       </nova:owner>
Nov 10 21:08:55 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:08:55 user nova-compute[75285]:       <nova:ports>
Nov 10 21:08:55 user nova-compute[75285]:         <nova:port uuid="e351ba01-6d16-40ea-ae88-097b9756cc70">
Nov 10 21:08:55 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 21:08:55 user nova-compute[75285]:         </nova:port>
Nov 10 21:08:55 user nova-compute[75285]:       </nova:ports>
Nov 10 21:08:55 user nova-compute[75285]:     </nova:instance>
Nov 10 21:08:55 user nova-compute[75285]:   </metadata>
Nov 10 21:08:55 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:08:55 user nova-compute[75285]:     <system>
Nov 10 21:08:55 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:08:55 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:08:55 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:08:55 user nova-compute[75285]:       <entry name="serial">32d2946b-f299-4b62-9f3b-6c00b0b8858b</entry>
Nov 10 21:08:55 user nova-compute[75285]:       <entry name="uuid">32d2946b-f299-4b62-9f3b-6c00b0b8858b</entry>
Nov 10 21:08:55 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:08:55 user nova-compute[75285]:     </system>
Nov 10 21:08:55 user nova-compute[75285]:   </sysinfo>
Nov 10 21:08:55 user nova-compute[75285]:   <os>
Nov 10 21:08:55 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:08:55 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:08:55 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:08:55 user nova-compute[75285]:   </os>
Nov 10 21:08:55 user nova-compute[75285]:   <features>
Nov 10 21:08:55 user nova-compute[75285]:     <acpi/>
Nov 10 21:08:55 user nova-compute[75285]:     <apic/>
Nov 10 21:08:55 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:08:55 user nova-compute[75285]:   </features>
Nov 10 21:08:55 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:08:55 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:08:55 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:08:55 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:08:55 user nova-compute[75285]:   </clock>
Nov 10 21:08:55 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:08:55 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:08:55 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:08:55 user nova-compute[75285]:   </cpu>
Nov 10 21:08:55 user nova-compute[75285]:   <devices>
Nov 10 21:08:55 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:08:55 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:08:55 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk"/>
Nov 10 21:08:55 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:08:55 user nova-compute[75285]:     </disk>
Nov 10 21:08:55 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:08:55 user nova-compute[75285]:       <mac address="fa:16:3e:a6:48:80"/>
Nov 10 21:08:55 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:08:55 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:08:55 user nova-compute[75285]:       <target dev="tape351ba01-6d"/>
Nov 10 21:08:55 user nova-compute[75285]:     </interface>
Nov 10 21:08:55 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:08:55 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/console.log" append="off"/>
Nov 10 21:08:55 user nova-compute[75285]:     </serial>
Nov 10 21:08:55 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:08:55 user nova-compute[75285]:     <video>
Nov 10 21:08:55 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:08:55 user nova-compute[75285]:     </video>
Nov 10 21:08:55 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:08:55 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:08:55 user nova-compute[75285]:     </rng>
Nov 10 21:08:55 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:08:55 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:08:55 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:08:55 user nova-compute[75285]:     </memballoon>
Nov 10 21:08:55 user nova-compute[75285]:   </devices>
Nov 10 21:08:55 user nova-compute[75285]: </domain>
Nov 10 21:08:55 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:08:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1960528635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1960528635',id=14,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9957f55c59044088e94338564e04092',ramdisk_id='',reservation_id='r-wc9q91fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-396261753',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:08:54Z,user_data=None,user_id='ac13c724170f47368e5a395110c631b7',uuid=32d2946b-f299-4b62-9f3b-6c00b0b8858b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e351ba01-6d16-40ea-ae88-097b9756cc70", "address": "fa:16:3e:a6:48:80", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape351ba01-6d", "ovs_interfaceid": "e351ba01-6d16-40ea-ae88-097b9756cc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converting VIF {"id": "e351ba01-6d16-40ea-ae88-097b9756cc70", "address": "fa:16:3e:a6:48:80", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape351ba01-6d", "ovs_interfaceid": "e351ba01-6d16-40ea-ae88-097b9756cc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e351ba01-6d16-40ea-ae88-097b9756cc70,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape351ba01-6d') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG os_vif [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e351ba01-6d16-40ea-ae88-097b9756cc70,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape351ba01-6d') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc0c0893-053b-540e-b0e2-7ad6d12059b7', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape351ba01-6d, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape351ba01-6d, col_values=(('qos', UUID('dc577e7f-1df2-4449-8f85-15952a77f1c7')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape351ba01-6d, col_values=(('external_ids', {'iface-id': 'e351ba01-6d16-40ea-ae88-097b9756cc70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:48:80', 'vm-uuid': '32d2946b-f299-4b62-9f3b-6c00b0b8858b'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:55 user nova-compute[75285]: INFO os_vif [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e351ba01-6d16-40ea-ae88-097b9756cc70,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape351ba01-6d')
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] No VIF found with MAC fa:16:3e:a6:48:80, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_power_states {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.network.neutron [req-e474341b-7eff-4489-b7ab-b8359fcaf3d9 req-96a7586a-2893-4aad-8acd-dd80e23d4277 service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Updated VIF entry in instance network info cache for port e351ba01-6d16-40ea-ae88-097b9756cc70. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG nova.network.neutron [req-e474341b-7eff-4489-b7ab-b8359fcaf3d9 req-96a7586a-2893-4aad-8acd-dd80e23d4277 service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Updating instance_info_cache with network_info: [{"id": "e351ba01-6d16-40ea-ae88-097b9756cc70", "address": "fa:16:3e:a6:48:80", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape351ba01-6d", "ovs_interfaceid": "e351ba01-6d16-40ea-ae88-097b9756cc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:08:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e474341b-7eff-4489-b7ab-b8359fcaf3d9 req-96a7586a-2893-4aad-8acd-dd80e23d4277 service nova] Releasing lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-2bf31941-9208-47d8-b29e-251ae77fe451 req-e31d28fe-4f88-40cc-896d-c0fc224e44e9 service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Received event network-vif-plugged-e351ba01-6d16-40ea-ae88-097b9756cc70 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2bf31941-9208-47d8-b29e-251ae77fe451 req-e31d28fe-4f88-40cc-896d-c0fc224e44e9 service nova] Acquiring lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2bf31941-9208-47d8-b29e-251ae77fe451 req-e31d28fe-4f88-40cc-896d-c0fc224e44e9 service nova] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2bf31941-9208-47d8-b29e-251ae77fe451 req-e31d28fe-4f88-40cc-896d-c0fc224e44e9 service nova] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-2bf31941-9208-47d8-b29e-251ae77fe451 req-e31d28fe-4f88-40cc-896d-c0fc224e44e9 service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] No waiting events found dispatching network-vif-plugged-e351ba01-6d16-40ea-ae88-097b9756cc70 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:57 user nova-compute[75285]: WARNING nova.compute.manager [req-2bf31941-9208-47d8-b29e-251ae77fe451 req-e31d28fe-4f88-40cc-896d-c0fc224e44e9 service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Received unexpected event network-vif-plugged-e351ba01-6d16-40ea-ae88-097b9756cc70 for instance with vm_state building and task_state spawning.
Nov 10 21:08:57 user nova-compute[75285]: WARNING nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] While synchronizing instance power states, found 9 instances in the database and 7 instances on the hypervisor.
Nov 10 21:08:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 16f56b6b-f08d-4650-b0eb-a202662b0eb6 {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 02b4446d-1538-4e80-b93d-5cb904b7b98f {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 62e8cc12-802e-415c-a166-4590715372c5 {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 6db680e7-3e21-4451-a0b1-29f9eca59b2f {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid aa74d6a6-3084-45c9-b15a-2b831077a3ac {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid e5fd224c-b34e-41b6-9bdf-28c88579b88c {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid ceb3b8d9-56f2-46b8-bf25-7e898328ee6b {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 20cb91b5-2a74-4f99-adf9-0db04167d2e0 {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 32d2946b-f299-4b62-9f3b-6c00b0b8858b {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "62e8cc12-802e-415c-a166-4590715372c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "62e8cc12-802e-415c-a166-4590715372c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "62e8cc12-802e-415c-a166-4590715372c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:08:59 user nova-compute[75285]: DEBUG nova.compute.manager [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:08:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:08:59 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Instance spawned successfully.
Nov 10 21:08:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:08:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:08:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:08:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:08:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:08:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:08:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:08:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-4bed863a-22c8-44f3-90f2-2231cf6454e1 req-f7f92b4d-e963-44a4-b1e3-336b90299e5d service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Received event network-vif-plugged-e351ba01-6d16-40ea-ae88-097b9756cc70 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:08:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4bed863a-22c8-44f3-90f2-2231cf6454e1 req-f7f92b4d-e963-44a4-b1e3-336b90299e5d service nova] Acquiring lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:08:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4bed863a-22c8-44f3-90f2-2231cf6454e1 req-f7f92b4d-e963-44a4-b1e3-336b90299e5d service nova] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4bed863a-22c8-44f3-90f2-2231cf6454e1 req-f7f92b4d-e963-44a4-b1e3-336b90299e5d service nova] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-4bed863a-22c8-44f3-90f2-2231cf6454e1 req-f7f92b4d-e963-44a4-b1e3-336b90299e5d service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] No waiting events found dispatching network-vif-plugged-e351ba01-6d16-40ea-ae88-097b9756cc70 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:08:59 user nova-compute[75285]: WARNING nova.compute.manager [req-4bed863a-22c8-44f3-90f2-2231cf6454e1 req-f7f92b4d-e963-44a4-b1e3-336b90299e5d service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Received unexpected event network-vif-plugged-e351ba01-6d16-40ea-ae88-097b9756cc70 for instance with vm_state building and task_state spawning.
Nov 10 21:08:59 user nova-compute[75285]: INFO nova.compute.manager [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 10 21:08:59 user nova-compute[75285]: DEBUG nova.compute.manager [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:08:59 user nova-compute[75285]: INFO nova.compute.manager [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Took 7.01 seconds to build instance.
Nov 10 21:08:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-40b8e819-8edc-4617-8bc3-cd4ea899c4c6 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.115s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:08:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.042s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:08:59 user nova-compute[75285]: INFO nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 10 21:08:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsJEWOdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:09:01 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:09:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:09:01 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:09:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:09:01 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[32322fab-b6a0-49ac-9f0b-e6f834d6eee1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:09:01 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f93645-147e-46c7-b9a4-2cf3ba7f41c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5] added
Nov 10 21:09:01 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6118ed2d-c273-4193-8c5a-12f93d1bb8de]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7395689-8ce5-47dc-8aa3-1ab65b6ea6af]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tsJEWOdD {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tsJEWOdD" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a38a9eb-25af-4949-a4ed-3bc28d160cae]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tsJEWOdD'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[51825c02-946a-4ef9-8599-92b75783f396]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee092e56-f9e8-4da6-a01a-d0695617354d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:09:01 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:09:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:09:01 user nova-compute[75285]:  {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:09:01 user nova-compute[75285]: WARNING os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 21:09:01 user nova-compute[75285]: 
Nov 10 21:09:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe202f3-4c24-4a38-ac3c-eb30a9149326]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5, portal: 172.16.0.220,3260]
Nov 10 21:09:02 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5, portal: 172.16.0.220,3260] successful.
Nov 10 21:09:02 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1e4554-eed7-4ce4-b524-bc92ab0456f4]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b006c6ed-94d3-493b-b22d-25e688a555ff]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 (non-flash)
Nov 10 21:09:02 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 (non-flash)
Nov 10 21:09:02 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e13a1a3-4d5a-4449-a1f9-13f0a15ceb8c]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:09:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsJEWOdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:09:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:09:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23966646438333137', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:09:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966646438333137', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:09:03 user nova-compute[75285]: DEBUG nova.objects.instance [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lazy-loading 'flavor' on Instance uuid e5fd224c-b34e-41b6-9bdf-28c88579b88c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:09:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:09:03 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:09:03 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:09:03 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:09:03 user nova-compute[75285]:   <serial>8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5</serial>
Nov 10 21:09:03 user nova-compute[75285]: </disk>
Nov 10 21:09:03 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:09:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:09:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:09:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] No VIF found with MAC fa:16:3e:2a:72:ba, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:09:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bea20364-84cf-4317-bd83-a30b7e58a4fb tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.112s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.207s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:06 user nova-compute[75285]: DEBUG nova.compute.manager [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:09:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:06 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:09:06 user nova-compute[75285]: INFO nova.compute.claims [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Claim successful on node user
Nov 10 21:09:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:06 user nova-compute[75285]: INFO nova.compute.manager [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Detaching volume 8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5
Nov 10 21:09:06 user nova-compute[75285]: INFO nova.virt.block_device [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Attempting to driver detach volume 8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 from mountpoint /dev/vdb
Nov 10 21:09:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Attempting to detach device vdb from instance e5fd224c-b34e-41b6-9bdf-28c88579b88c from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:09:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:09:06 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:09:06 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:09:06 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:09:06 user nova-compute[75285]:   <serial>8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5</serial>
Nov 10 21:09:06 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:09:06 user nova-compute[75285]: </disk>
Nov 10 21:09:06 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:09:06 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Successfully detached device vdb from instance e5fd224c-b34e-41b6-9bdf-28c88579b88c from the persistent domain config.
Nov 10 21:09:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5fd224c-b34e-41b6-9bdf-28c88579b88c from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:09:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:09:06 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:09:06 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:09:06 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:09:06 user nova-compute[75285]:   <serial>8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5</serial>
Nov 10 21:09:06 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:09:06 user nova-compute[75285]: </disk>
Nov 10 21:09:06 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:09:06 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:09:06 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:09:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.717s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:06 user nova-compute[75285]: DEBUG nova.compute.manager [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG nova.compute.manager [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG nova.network.neutron [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:09:07 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:09:07 user nova-compute[75285]: DEBUG nova.compute.manager [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5fd224c-b34e-41b6-9bdf-28c88579b88c {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG nova.policy [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8a625a7d0264f49ad3ddbbdeca81fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159848b23a33449aa7eef3b73061912d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG nova.compute.manager [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:09:07 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Creating image(s)
Nov 10 21:09:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "/opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "/opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "/opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.226s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.206s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk 1073741824" returned: 0 in 0.058s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.225s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:08 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:09:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:08 user nova-compute[75285]: DEBUG nova.network.neutron [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Successfully created port: bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:09:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:08 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Cannot resize image /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:09:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:09:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Ensure instance console log exists: /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:09:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:09 user nova-compute[75285]: DEBUG nova.network.neutron [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Successfully updated port: bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:09:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:09:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquired lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:09:09 user nova-compute[75285]: DEBUG nova.network.neutron [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:09:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-d85cb10e-af51-45ca-986e-a32f658a69d1 req-f31810a9-b2d4-4df9-8b23-8a55a7d61478 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-changed-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-d85cb10e-af51-45ca-986e-a32f658a69d1 req-f31810a9-b2d4-4df9-8b23-8a55a7d61478 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Refreshing instance network info cache due to event network-changed-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:09:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d85cb10e-af51-45ca-986e-a32f658a69d1 req-f31810a9-b2d4-4df9-8b23-8a55a7d61478 service nova] Acquiring lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:09:09 user nova-compute[75285]: DEBUG nova.network.neutron [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:09:09 user nova-compute[75285]: INFO nova.compute.manager [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] Took 45.52 seconds to detach 3 volumes for instance.
Nov 10 21:09:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.network.neutron [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updating instance_info_cache with network_info: [{"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Releasing lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Instance network_info: |[{"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d85cb10e-af51-45ca-986e-a32f658a69d1 req-f31810a9-b2d4-4df9-8b23-8a55a7d61478 service nova] Acquired lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.network.neutron [req-d85cb10e-af51-45ca-986e-a32f658a69d1 req-f31810a9-b2d4-4df9-8b23-8a55a7d61478 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Refreshing network info cache for port bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Start _get_guest_xml network_info=[{"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:09:10 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:09:10 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:09:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-811159608',display_name='tempest-ServerStableDeviceRescueTest-server-811159608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-811159608',id=15,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU07Ee5gBfRVYMO1ihS+0v5mu4gwIvzqpIBvB/vUtCSDnxXiUb7ZTEwrZe/CpZEFTOFu4c1jqCagvop9YQAVI0CVZqSTeskkQBWLzNdLeTJXM3Pqa79j1/Ny7cbPqCWiw==',key_name='tempest-keypair-2027067703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='159848b23a33449aa7eef3b73061912d',ramdisk_id='',reservation_id='r-0drfnm4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1367693602',owner_user_name='tempest-ServerStableDeviceRescueTest-1367693602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8a625a7d0264f49ad3ddbbdeca81fef',uuid=09ab2e54-1189-420e-9e5c-d158e4106ffd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Converting VIF {"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9a:13,bridge_name='br-int',has_traffic_filtering=True,id=bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef,network=Network(1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8d1ec8-27') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.objects.instance [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lazy-loading 'pci_devices' on Instance uuid 09ab2e54-1189-420e-9e5c-d158e4106ffd {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:09:10 user nova-compute[75285]:   <uuid>09ab2e54-1189-420e-9e5c-d158e4106ffd</uuid>
Nov 10 21:09:10 user nova-compute[75285]:   <name>instance-0000000f</name>
Nov 10 21:09:10 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:09:10 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:09:10 user nova-compute[75285]:   <metadata>
Nov 10 21:09:10 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:09:10 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:09:10 user nova-compute[75285]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-811159608</nova:name>
Nov 10 21:09:10 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:09:10</nova:creationTime>
Nov 10 21:09:10 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:09:10 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:09:10 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:09:10 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:09:10 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:09:10 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:09:10 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:09:10 user nova-compute[75285]:       <nova:owner>
Nov 10 21:09:10 user nova-compute[75285]:         <nova:user uuid="a8a625a7d0264f49ad3ddbbdeca81fef">tempest-ServerStableDeviceRescueTest-1367693602-project-member</nova:user>
Nov 10 21:09:10 user nova-compute[75285]:         <nova:project uuid="159848b23a33449aa7eef3b73061912d">tempest-ServerStableDeviceRescueTest-1367693602</nova:project>
Nov 10 21:09:10 user nova-compute[75285]:       </nova:owner>
Nov 10 21:09:10 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:09:10 user nova-compute[75285]:       <nova:ports>
Nov 10 21:09:10 user nova-compute[75285]:         <nova:port uuid="bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef">
Nov 10 21:09:10 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 21:09:10 user nova-compute[75285]:         </nova:port>
Nov 10 21:09:10 user nova-compute[75285]:       </nova:ports>
Nov 10 21:09:10 user nova-compute[75285]:     </nova:instance>
Nov 10 21:09:10 user nova-compute[75285]:   </metadata>
Nov 10 21:09:10 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:09:10 user nova-compute[75285]:     <system>
Nov 10 21:09:10 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:09:10 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:09:10 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:09:10 user nova-compute[75285]:       <entry name="serial">09ab2e54-1189-420e-9e5c-d158e4106ffd</entry>
Nov 10 21:09:10 user nova-compute[75285]:       <entry name="uuid">09ab2e54-1189-420e-9e5c-d158e4106ffd</entry>
Nov 10 21:09:10 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:09:10 user nova-compute[75285]:     </system>
Nov 10 21:09:10 user nova-compute[75285]:   </sysinfo>
Nov 10 21:09:10 user nova-compute[75285]:   <os>
Nov 10 21:09:10 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:09:10 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:09:10 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:09:10 user nova-compute[75285]:   </os>
Nov 10 21:09:10 user nova-compute[75285]:   <features>
Nov 10 21:09:10 user nova-compute[75285]:     <acpi/>
Nov 10 21:09:10 user nova-compute[75285]:     <apic/>
Nov 10 21:09:10 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:09:10 user nova-compute[75285]:   </features>
Nov 10 21:09:10 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:09:10 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:09:10 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:09:10 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:09:10 user nova-compute[75285]:   </clock>
Nov 10 21:09:10 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:09:10 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:09:10 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:09:10 user nova-compute[75285]:   </cpu>
Nov 10 21:09:10 user nova-compute[75285]:   <devices>
Nov 10 21:09:10 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:09:10 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:09:10 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk"/>
Nov 10 21:09:10 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:09:10 user nova-compute[75285]:     </disk>
Nov 10 21:09:10 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:09:10 user nova-compute[75285]:       <mac address="fa:16:3e:98:9a:13"/>
Nov 10 21:09:10 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:09:10 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:09:10 user nova-compute[75285]:       <target dev="tapbd8d1ec8-27"/>
Nov 10 21:09:10 user nova-compute[75285]:     </interface>
Nov 10 21:09:10 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:09:10 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/console.log" append="off"/>
Nov 10 21:09:10 user nova-compute[75285]:     </serial>
Nov 10 21:09:10 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:09:10 user nova-compute[75285]:     <video>
Nov 10 21:09:10 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:09:10 user nova-compute[75285]:     </video>
Nov 10 21:09:10 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:09:10 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:09:10 user nova-compute[75285]:     </rng>
Nov 10 21:09:10 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:09:10 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:09:10 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:09:10 user nova-compute[75285]:     </memballoon>
Nov 10 21:09:10 user nova-compute[75285]:   </devices>
Nov 10 21:09:10 user nova-compute[75285]: </domain>
Nov 10 21:09:10 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:09:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-811159608',display_name='tempest-ServerStableDeviceRescueTest-server-811159608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-811159608',id=15,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU07Ee5gBfRVYMO1ihS+0v5mu4gwIvzqpIBvB/vUtCSDnxXiUb7ZTEwrZe/CpZEFTOFu4c1jqCagvop9YQAVI0CVZqSTeskkQBWLzNdLeTJXM3Pqa79j1/Ny7cbPqCWiw==',key_name='tempest-keypair-2027067703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='159848b23a33449aa7eef3b73061912d',ramdisk_id='',reservation_id='r-0drfnm4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1367693602',owner_user_name='tempest-ServerStableDeviceRescueTest-1367693602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8a625a7d0264f49ad3ddbbdeca81fef',uuid=09ab2e54-1189-420e-9e5c-d158e4106ffd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Converting VIF {"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9a:13,bridge_name='br-int',has_traffic_filtering=True,id=bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef,network=Network(1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8d1ec8-27') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_vif [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9a:13,bridge_name='br-int',has_traffic_filtering=True,id=bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef,network=Network(1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8d1ec8-27') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6850e9d-ae75-5f63-ab63-1e021f8d9c68', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd8d1ec8-27, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd8d1ec8-27, col_values=(('qos', UUID('adf1350b-bc7e-4489-a485-d08288ce5c8c')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd8d1ec8-27, col_values=(('external_ids', {'iface-id': 'bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:9a:13', 'vm-uuid': '09ab2e54-1189-420e-9e5c-d158e4106ffd'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:09:10 user nova-compute[75285]: INFO os_vif [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9a:13,bridge_name='br-int',has_traffic_filtering=True,id=bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef,network=Network(1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8d1ec8-27')
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.586s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:10 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Deleted allocations for instance aa74d6a6-3084-45c9-b15a-2b831077a3ac
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] No VIF found with MAC fa:16:3e:98:9a:13, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:09:10 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Creating image(s)
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Did not create local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Ensure instance console log exists: /opt/stack/data/nova/instances/20cb91b5-2a74-4f99-adf9-0db04167d2e0/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Start _get_guest_xml network_info=[{"id": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "address": "fa:16:3e:0a:41:02", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd04dae-2f", "ovs_interfaceid": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'be633795-f961-428d-b67a-8437a4d652cc', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADakSLgR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '20cb91b5-2a74-4f99-adf9-0db04167d2e0', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4eab6db-4ab1-41cb-909d-ff1162c43906', 'serial': 'e4eab6db-4ab1-41cb-909d-ff1162c43906'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ff3ed173-409c-4115-ba0c-a4a801bc3109 tempest-TaggedBootDevicesTest_v242-280000780 tempest-TaggedBootDevicesTest_v242-280000780-project-member] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 53.754s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.892s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:10 user nova-compute[75285]: INFO nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: aa74d6a6-3084-45c9-b15a-2b831077a3ac] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "aa74d6a6-3084-45c9-b15a-2b831077a3ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:10 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:09:10 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADakSLgR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:09:10 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:09:10 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:09:10 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0024378a-d001-420c-bd8d-60a5ff45b634]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:09:10 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6245917-bcb8-4228-9a62-c01215a2e379]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906] added
Nov 10 21:09:10 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4a18ad-3b37-4050-bfcf-c8b33b77df08]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46b4bb9-1a1a-4920-89f2-deb6a48cf1fc]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADakSLgR {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.network.neutron [req-d85cb10e-af51-45ca-986e-a32f658a69d1 req-f31810a9-b2d4-4df9-8b23-8a55a7d61478 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updated VIF entry in instance network info cache for port bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG nova.network.neutron [req-d85cb10e-af51-45ca-986e-a32f658a69d1 req-f31810a9-b2d4-4df9-8b23-8a55a7d61478 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updating instance_info_cache with network_info: [{"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADakSLgR" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d49a81-3c42-4254-b358-aff59b813bc9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ADakSLgR'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d85cb10e-af51-45ca-986e-a32f658a69d1 req-f31810a9-b2d4-4df9-8b23-8a55a7d61478 service nova] Releasing lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a87da47-1243-4e28-9dc6-46bea1aaeccc]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[617fe880-8f13-49cc-ab0a-c0b030791c8b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 (non-flash)
Nov 10 21:09:10 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 (non-flash)
Nov 10 21:09:10 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[545918ac-25c7-4144-bef4-2caf13c46bf1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906, portal: 172.16.0.220,3260]
Nov 10 21:09:10 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906, portal: 172.16.0.220,3260] successful.
Nov 10 21:09:10 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e0d6a2-ea2c-4b6c-9041-9432280c0e97]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcb4acc-3e6d-4791-8bfc-b00233b01470]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 (non-flash)
Nov 10 21:09:11 user nova-compute[75285]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:09:11 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 (non-flash)
Nov 10 21:09:11 user nova-compute[75285]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:09:11 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c460025-0ceb-4a08-a3dc-9e0616d41889]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:11 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADakSLgR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26633613933613436', 'path': '/dev/sdc'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633613933613436', 'path': '/dev/sdc'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:08:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-861996084',display_name='tempest-TestVolumeBootPattern-server-861996084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-861996084',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04636b8a9e404d40a3a2bc9f63a4df8c',ramdisk_id='',reservation_id='r-007u3ntr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1962512242',owner_user_name='tempest-TestVolumeBootPattern-1962512242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:08:15Z,user_data=None,user_id='e16c471c0875416aa0eb86d89eef3a27',uuid=20cb91b5-2a74-4f99-adf9-0db04167d2e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "address": "fa:16:3e:0a:41:02", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd04dae-2f", "ovs_interfaceid": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converting VIF {"id": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "address": "fa:16:3e:0a:41:02", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd04dae-2f", "ovs_interfaceid": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:41:02,bridge_name='br-int',has_traffic_filtering=True,id=3dd04dae-2f80-4478-bfe4-e97bf0389700,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd04dae-2f') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG nova.objects.instance [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lazy-loading 'pci_devices' on Instance uuid 20cb91b5-2a74-4f99-adf9-0db04167d2e0 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:09:12 user nova-compute[75285]:   <uuid>20cb91b5-2a74-4f99-adf9-0db04167d2e0</uuid>
Nov 10 21:09:12 user nova-compute[75285]:   <name>instance-0000000d</name>
Nov 10 21:09:12 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:09:12 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:09:12 user nova-compute[75285]:   <metadata>
Nov 10 21:09:12 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:09:12 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:09:12 user nova-compute[75285]:       <nova:name>tempest-TestVolumeBootPattern-server-861996084</nova:name>
Nov 10 21:09:12 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:09:10</nova:creationTime>
Nov 10 21:09:12 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:09:12 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:09:12 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:09:12 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:09:12 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:09:12 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:09:12 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:09:12 user nova-compute[75285]:       <nova:owner>
Nov 10 21:09:12 user nova-compute[75285]:         <nova:user uuid="e16c471c0875416aa0eb86d89eef3a27">tempest-TestVolumeBootPattern-1962512242-project-member</nova:user>
Nov 10 21:09:12 user nova-compute[75285]:         <nova:project uuid="04636b8a9e404d40a3a2bc9f63a4df8c">tempest-TestVolumeBootPattern-1962512242</nova:project>
Nov 10 21:09:12 user nova-compute[75285]:       </nova:owner>
Nov 10 21:09:12 user nova-compute[75285]:       <nova:ports>
Nov 10 21:09:12 user nova-compute[75285]:         <nova:port uuid="3dd04dae-2f80-4478-bfe4-e97bf0389700">
Nov 10 21:09:12 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 21:09:12 user nova-compute[75285]:         </nova:port>
Nov 10 21:09:12 user nova-compute[75285]:       </nova:ports>
Nov 10 21:09:12 user nova-compute[75285]:     </nova:instance>
Nov 10 21:09:12 user nova-compute[75285]:   </metadata>
Nov 10 21:09:12 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:09:12 user nova-compute[75285]:     <system>
Nov 10 21:09:12 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:09:12 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:09:12 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:09:12 user nova-compute[75285]:       <entry name="serial">20cb91b5-2a74-4f99-adf9-0db04167d2e0</entry>
Nov 10 21:09:12 user nova-compute[75285]:       <entry name="uuid">20cb91b5-2a74-4f99-adf9-0db04167d2e0</entry>
Nov 10 21:09:12 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:09:12 user nova-compute[75285]:     </system>
Nov 10 21:09:12 user nova-compute[75285]:   </sysinfo>
Nov 10 21:09:12 user nova-compute[75285]:   <os>
Nov 10 21:09:12 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:09:12 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:09:12 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:09:12 user nova-compute[75285]:   </os>
Nov 10 21:09:12 user nova-compute[75285]:   <features>
Nov 10 21:09:12 user nova-compute[75285]:     <acpi/>
Nov 10 21:09:12 user nova-compute[75285]:     <apic/>
Nov 10 21:09:12 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:09:12 user nova-compute[75285]:   </features>
Nov 10 21:09:12 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:09:12 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:09:12 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:09:12 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:09:12 user nova-compute[75285]:   </clock>
Nov 10 21:09:12 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:09:12 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:09:12 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:09:12 user nova-compute[75285]:   </cpu>
Nov 10 21:09:12 user nova-compute[75285]:   <devices>
Nov 10 21:09:12 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:09:12 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:09:12 user nova-compute[75285]:       <source dev="/dev/sdc"/>
Nov 10 21:09:12 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:09:12 user nova-compute[75285]:       <serial>e4eab6db-4ab1-41cb-909d-ff1162c43906</serial>
Nov 10 21:09:12 user nova-compute[75285]:     </disk>
Nov 10 21:09:12 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:09:12 user nova-compute[75285]:       <mac address="fa:16:3e:0a:41:02"/>
Nov 10 21:09:12 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:09:12 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:09:12 user nova-compute[75285]:       <target dev="tap3dd04dae-2f"/>
Nov 10 21:09:12 user nova-compute[75285]:     </interface>
Nov 10 21:09:12 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:09:12 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/20cb91b5-2a74-4f99-adf9-0db04167d2e0/console.log" append="off"/>
Nov 10 21:09:12 user nova-compute[75285]:     </serial>
Nov 10 21:09:12 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:09:12 user nova-compute[75285]:     <video>
Nov 10 21:09:12 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:09:12 user nova-compute[75285]:     </video>
Nov 10 21:09:12 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:09:12 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:09:12 user nova-compute[75285]:     </rng>
Nov 10 21:09:12 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:09:12 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:09:12 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:09:12 user nova-compute[75285]:     </memballoon>
Nov 10 21:09:12 user nova-compute[75285]:   </devices>
Nov 10 21:09:12 user nova-compute[75285]: </domain>
Nov 10 21:09:12 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:08:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-861996084',display_name='tempest-TestVolumeBootPattern-server-861996084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-861996084',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04636b8a9e404d40a3a2bc9f63a4df8c',ramdisk_id='',reservation_id='r-007u3ntr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1962512242',owner_user_name='tempest-TestVolumeBootPattern-1962512242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:08:15Z,user_data=None,user_id='e16c471c0875416aa0eb86d89eef3a27',uuid=20cb91b5-2a74-4f99-adf9-0db04167d2e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "address": "fa:16:3e:0a:41:02", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd04dae-2f", "ovs_interfaceid": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converting VIF {"id": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "address": "fa:16:3e:0a:41:02", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd04dae-2f", "ovs_interfaceid": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:41:02,bridge_name='br-int',has_traffic_filtering=True,id=3dd04dae-2f80-4478-bfe4-e97bf0389700,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd04dae-2f') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG os_vif [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:41:02,bridge_name='br-int',has_traffic_filtering=True,id=3dd04dae-2f80-4478-bfe4-e97bf0389700,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd04dae-2f') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7fa0fd5d-5e80-5f98-a9ed-d71110f42bb7', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dd04dae-2f, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3dd04dae-2f, col_values=(('qos', UUID('204f767c-3fef-490c-8a20-0422ac2fde69')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3dd04dae-2f, col_values=(('external_ids', {'iface-id': '3dd04dae-2f80-4478-bfe4-e97bf0389700', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:41:02', 'vm-uuid': '20cb91b5-2a74-4f99-adf9-0db04167d2e0'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:12 user nova-compute[75285]: INFO os_vif [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:41:02,bridge_name='br-int',has_traffic_filtering=True,id=3dd04dae-2f80-4478-bfe4-e97bf0389700,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd04dae-2f')
Nov 10 21:09:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] No VIF found with MAC fa:16:3e:0a:41:02, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG nova.compute.manager [req-0bee10ee-fa80-4296-9fd2-9e57dd4356a9 req-efd6746f-fa96-40ca-8188-6ada5e69e416 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0bee10ee-fa80-4296-9fd2-9e57dd4356a9 req-efd6746f-fa96-40ca-8188-6ada5e69e416 service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0bee10ee-fa80-4296-9fd2-9e57dd4356a9 req-efd6746f-fa96-40ca-8188-6ada5e69e416 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0bee10ee-fa80-4296-9fd2-9e57dd4356a9 req-efd6746f-fa96-40ca-8188-6ada5e69e416 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG nova.compute.manager [req-0bee10ee-fa80-4296-9fd2-9e57dd4356a9 req-efd6746f-fa96-40ca-8188-6ada5e69e416 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:09:12 user nova-compute[75285]: WARNING nova.compute.manager [req-0bee10ee-fa80-4296-9fd2-9e57dd4356a9 req-efd6746f-fa96-40ca-8188-6ada5e69e416 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state building and task_state spawning.
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-787fadc8-0b9b-4e42-a264-12958969e95e req-01ed6658-1a14-4e10-a185-3bc9044edb9b service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-787fadc8-0b9b-4e42-a264-12958969e95e req-01ed6658-1a14-4e10-a185-3bc9044edb9b service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-787fadc8-0b9b-4e42-a264-12958969e95e req-01ed6658-1a14-4e10-a185-3bc9044edb9b service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-787fadc8-0b9b-4e42-a264-12958969e95e req-01ed6658-1a14-4e10-a185-3bc9044edb9b service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-787fadc8-0b9b-4e42-a264-12958969e95e req-01ed6658-1a14-4e10-a185-3bc9044edb9b service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:09:14 user nova-compute[75285]: WARNING nova.compute.manager [req-787fadc8-0b9b-4e42-a264-12958969e95e req-01ed6658-1a14-4e10-a185-3bc9044edb9b service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state building and task_state spawning.
Nov 10 21:09:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-787fadc8-0b9b-4e42-a264-12958969e95e req-01ed6658-1a14-4e10-a185-3bc9044edb9b service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Received event network-vif-plugged-3dd04dae-2f80-4478-bfe4-e97bf0389700 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-787fadc8-0b9b-4e42-a264-12958969e95e req-01ed6658-1a14-4e10-a185-3bc9044edb9b service nova] Acquiring lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-787fadc8-0b9b-4e42-a264-12958969e95e req-01ed6658-1a14-4e10-a185-3bc9044edb9b service nova] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-787fadc8-0b9b-4e42-a264-12958969e95e req-01ed6658-1a14-4e10-a185-3bc9044edb9b service nova] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-787fadc8-0b9b-4e42-a264-12958969e95e req-01ed6658-1a14-4e10-a185-3bc9044edb9b service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] No waiting events found dispatching network-vif-plugged-3dd04dae-2f80-4478-bfe4-e97bf0389700 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:09:14 user nova-compute[75285]: WARNING nova.compute.manager [req-787fadc8-0b9b-4e42-a264-12958969e95e req-01ed6658-1a14-4e10-a185-3bc9044edb9b service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Received unexpected event network-vif-plugged-3dd04dae-2f80-4478-bfe4-e97bf0389700 for instance with vm_state building and task_state spawning.
Nov 10 21:09:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:09:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:09:15 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Instance spawned successfully.
Nov 10 21:09:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:09:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:09:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:09:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:09:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:09:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:09:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:09:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:16 user nova-compute[75285]: INFO nova.compute.manager [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Took 8.81 seconds to spawn the instance on the hypervisor.
Nov 10 21:09:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:09:16 user nova-compute[75285]: INFO nova.compute.manager [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Took 9.99 seconds to build instance.
Nov 10 21:09:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-49276803-7a31-42a0-abe0-192b8d4d5409 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.102s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-9249ed7a-3068-49cb-a4b3-762dbd6fc88c req-5e96b4ad-cfd6-4475-8cbe-7780faf18a58 service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Received event network-vif-plugged-3dd04dae-2f80-4478-bfe4-e97bf0389700 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9249ed7a-3068-49cb-a4b3-762dbd6fc88c req-5e96b4ad-cfd6-4475-8cbe-7780faf18a58 service nova] Acquiring lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9249ed7a-3068-49cb-a4b3-762dbd6fc88c req-5e96b4ad-cfd6-4475-8cbe-7780faf18a58 service nova] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9249ed7a-3068-49cb-a4b3-762dbd6fc88c req-5e96b4ad-cfd6-4475-8cbe-7780faf18a58 service nova] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-9249ed7a-3068-49cb-a4b3-762dbd6fc88c req-5e96b4ad-cfd6-4475-8cbe-7780faf18a58 service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] No waiting events found dispatching network-vif-plugged-3dd04dae-2f80-4478-bfe4-e97bf0389700 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:09:16 user nova-compute[75285]: WARNING nova.compute.manager [req-9249ed7a-3068-49cb-a4b3-762dbd6fc88c req-5e96b4ad-cfd6-4475-8cbe-7780faf18a58 service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Received unexpected event network-vif-plugged-3dd04dae-2f80-4478-bfe4-e97bf0389700 for instance with vm_state building and task_state spawning.
Nov 10 21:09:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:09:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:09:16 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Instance spawned successfully.
Nov 10 21:09:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:09:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:09:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:09:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:09:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:09:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:09:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:09:16 user nova-compute[75285]: INFO nova.compute.manager [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 10 21:09:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:09:16 user nova-compute[75285]: INFO nova.compute.manager [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Took 62.85 seconds to build instance.
Nov 10 21:09:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f24dc658-f739-4ac6-887d-d7f3d89488b2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 62.964s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.089s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:16 user nova-compute[75285]: INFO nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 10 21:09:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "26bec53a-de52-4a18-b778-8f917cace2dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:21 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:09:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:22 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:09:22 user nova-compute[75285]: INFO nova.compute.claims [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Claim successful on node user
Nov 10 21:09:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:22 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:09:22 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:09:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:09:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:09:22 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:09:22 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:09:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:09:22 user nova-compute[75285]: INFO nova.virt.block_device [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Booting with volume 64430c41-05b2-4af5-8bd9-fb3888479da8 at /dev/vda
Nov 10 21:09:23 user nova-compute[75285]: DEBUG os_brick.utils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9864ef35-2189-4676-88aa-167a5d8cd4a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG nova.policy [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '934f46eb81fc4e1fb900b25a7e9500c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '415f8f5d956148b7ad22cd31c04ceb37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6184c1c1-eef1-413a-8a76-bc2c06251276]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20ec630-6e67-4de8-a430-7ddb3410b38e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e41603-cf39-4292-95c5-6f9e2e5f5c63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:09:23 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:09:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdb36f0-5ad4-4c9b-bfc6-ee23dd9f3033]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG os_brick.utils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating existing volume attachment record: 1198f1e1-c2e7-4ba4-9f9b-9cc70ddcd8a6 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:09:23 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Successfully created port: a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:09:24 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Successfully created port: fb52e593-077b-4368-93c0-aa9e1ad6717f {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:09:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:24 user nova-compute[75285]: INFO nova.compute.manager [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Terminating instance
Nov 10 21:09:24 user nova-compute[75285]: DEBUG nova.compute.manager [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:09:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-e5236b6e-9ebf-4d38-9eb7-5ae156876039 req-c3e6caed-c045-4158-bc6b-4e1cfce3ab0f service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Received event network-vif-unplugged-6362417a-7037-4856-a26a-6b9dfb7ceda6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e5236b6e-9ebf-4d38-9eb7-5ae156876039 req-c3e6caed-c045-4158-bc6b-4e1cfce3ab0f service nova] Acquiring lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e5236b6e-9ebf-4d38-9eb7-5ae156876039 req-c3e6caed-c045-4158-bc6b-4e1cfce3ab0f service nova] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e5236b6e-9ebf-4d38-9eb7-5ae156876039 req-c3e6caed-c045-4158-bc6b-4e1cfce3ab0f service nova] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-e5236b6e-9ebf-4d38-9eb7-5ae156876039 req-c3e6caed-c045-4158-bc6b-4e1cfce3ab0f service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] No waiting events found dispatching network-vif-unplugged-6362417a-7037-4856-a26a-6b9dfb7ceda6 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:09:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-e5236b6e-9ebf-4d38-9eb7-5ae156876039 req-c3e6caed-c045-4158-bc6b-4e1cfce3ab0f service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Received event network-vif-unplugged-6362417a-7037-4856-a26a-6b9dfb7ceda6 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:25 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Instance destroyed successfully.
Nov 10 21:09:25 user nova-compute[75285]: DEBUG nova.objects.instance [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lazy-loading 'resources' on Instance uuid ceb3b8d9-56f2-46b8-bf25-7e898328ee6b {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1205085645',display_name='tempest-VolumesAdminNegativeTest-server-1205085645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1205085645',id=12,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:07:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfa427a4529a400b9f1067e756f7c681',ramdisk_id='',reservation_id='r-996kp52t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-554707513',owner_user_name='tempest-VolumesAdminNegativeTest-554707513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:07:01Z,user_data=None,user_id='92fecbd1e3364a73a2b02edfba7e894e',uuid=ceb3b8d9-56f2-46b8-bf25-7e898328ee6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "address": "fa:16:3e:94:a8:32", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362417a-70", "ovs_interfaceid": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Converting VIF {"id": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "address": "fa:16:3e:94:a8:32", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6362417a-70", "ovs_interfaceid": "6362417a-7037-4856-a26a-6b9dfb7ceda6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=6362417a-7037-4856-a26a-6b9dfb7ceda6,network=Network(ed40fbcd-a68a-4582-805a-09cdd3206893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6362417a-70') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG os_vif [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=6362417a-7037-4856-a26a-6b9dfb7ceda6,network=Network(ed40fbcd-a68a-4582-805a-09cdd3206893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6362417a-70') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6362417a-70, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Successfully created port: e19633a5-3e53-4b50-8b33-ec86a745a45d {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4a3659c-2e90-4eec-8de8-c07d54d45b16) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:09:25 user nova-compute[75285]: INFO os_vif [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:a8:32,bridge_name='br-int',has_traffic_filtering=True,id=6362417a-7037-4856-a26a-6b9dfb7ceda6,network=Network(ed40fbcd-a68a-4582-805a-09cdd3206893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6362417a-70')
Nov 10 21:09:25 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Deleting instance files /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b_del
Nov 10 21:09:25 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Deletion of /opt/stack/data/nova/instances/ceb3b8d9-56f2-46b8-bf25-7e898328ee6b_del complete
Nov 10 21:09:25 user nova-compute[75285]: INFO nova.compute.manager [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 10 21:09:25 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:09:25 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:09:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:26 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:09:26 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Took 0.66 seconds to deallocate network for instance.
Nov 10 21:09:26 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Successfully created port: bd2b2398-97ca-4072-b5d8-905d2011fd16 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:09:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:26 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:09:26 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:09:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:26 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Deleted allocations for instance ceb3b8d9-56f2-46b8-bf25-7e898328ee6b
Nov 10 21:09:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1e9c008b-7062-45e7-b112-7f7f1baa9f39 tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.353s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-0def29dc-4370-43d8-8e1f-15b8fbe48eff req-d1afc683-c581-40a6-9461-5a4ea6bd365a service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Received event network-vif-plugged-6362417a-7037-4856-a26a-6b9dfb7ceda6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0def29dc-4370-43d8-8e1f-15b8fbe48eff req-d1afc683-c581-40a6-9461-5a4ea6bd365a service nova] Acquiring lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0def29dc-4370-43d8-8e1f-15b8fbe48eff req-d1afc683-c581-40a6-9461-5a4ea6bd365a service nova] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0def29dc-4370-43d8-8e1f-15b8fbe48eff req-d1afc683-c581-40a6-9461-5a4ea6bd365a service nova] Lock "ceb3b8d9-56f2-46b8-bf25-7e898328ee6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-0def29dc-4370-43d8-8e1f-15b8fbe48eff req-d1afc683-c581-40a6-9461-5a4ea6bd365a service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] No waiting events found dispatching network-vif-plugged-6362417a-7037-4856-a26a-6b9dfb7ceda6 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:09:27 user nova-compute[75285]: WARNING nova.compute.manager [req-0def29dc-4370-43d8-8e1f-15b8fbe48eff req-d1afc683-c581-40a6-9461-5a4ea6bd365a service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Received unexpected event network-vif-plugged-6362417a-7037-4856-a26a-6b9dfb7ceda6 for instance with vm_state deleted and task_state None.
Nov 10 21:09:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-0def29dc-4370-43d8-8e1f-15b8fbe48eff req-d1afc683-c581-40a6-9461-5a4ea6bd365a service nova] [instance: ceb3b8d9-56f2-46b8-bf25-7e898328ee6b] Received event network-vif-deleted-6362417a-7037-4856-a26a-6b9dfb7ceda6 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Successfully created port: 3496e5b6-03c7-4c7b-9a71-932ed44c1b5e {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:09:27 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e5fd224c-b34e-41b6-9bdf-28c88579b88c is timed out.
Nov 10 21:09:27 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Successfully detached device vdb from instance e5fd224c-b34e-41b6-9bdf-28c88579b88c from the live domain config.
Nov 10 21:09:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tsJEWOdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:09:27 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[83591429-3b35-4f6a-af3a-3487863357ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:09:27 user nova-compute[75285]: No targets found.
Nov 10 21:09:27 user nova-compute[75285]: iSNS:
Nov 10 21:09:27 user nova-compute[75285]: No targets found.
Nov 10 21:09:27 user nova-compute[75285]: STATIC:
Nov 10 21:09:27 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906
Nov 10 21:09:27 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:09:27 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:09:27 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5
Nov 10 21:09:27 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:09:27 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:09:27 user nova-compute[75285]: FIRMWARE:
Nov 10 21:09:27 user nova-compute[75285]: No targets found.
Nov 10 21:09:27 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:09:27 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:09:27 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a762769-221d-46f5-ad44-5e54325d327a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d93e8a-64db-4b50-82c8-45335bb7d5e0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 (non-flash)
Nov 10 21:09:27 user nova-compute[75285]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:09:27 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 (non-flash)
Nov 10 21:09:27 user nova-compute[75285]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:09:27 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e46d4dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[803a51a7-4c45-47c6-b19b-b9b801ac9d77]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2cf647-9640-4f19-9bef-b5fce1d09c8a]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3aac866-7320-40fc-870e-342e326719ce]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dee1b22-5918-4ca7-a594-0e132af5f11c]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff18308-c838-4153-84d0-d08505b39623]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a2781b-2f65-437c-918e-66c5611b9e5f]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5, portal: 172.16.0.220,3260]
Nov 10 21:09:27 user nova-compute[75285]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5, portal: 172.16.0.220,3260] successful.
Nov 10 21:09:27 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fa1ebf0-a85f-4755-a6d4-44c77f9aaca5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aaba18-3560-4e18-8b7a-77ef6bf0f9de]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] <== disconnect_volume: return (348ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:09:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:09:28 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Successfully updated port: a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:09:28 user nova-compute[75285]: INFO nova.compute.manager [None req-fe4b703c-4d75-4a58-b612-121c95b38d2f tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Unrescuing
Nov 10 21:09:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe4b703c-4d75-4a58-b612-121c95b38d2f tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:09:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe4b703c-4d75-4a58-b612-121c95b38d2f tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquired lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:09:28 user nova-compute[75285]: DEBUG nova.network.neutron [None req-fe4b703c-4d75-4a58-b612-121c95b38d2f tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:09:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-cf38c281-11d4-484f-9ff9-c5a9b01de313 req-ee0ba7db-c12a-49d0-82cb-0894d042716b service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-changed-a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-cf38c281-11d4-484f-9ff9-c5a9b01de313 req-ee0ba7db-c12a-49d0-82cb-0894d042716b service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing instance network info cache due to event network-changed-a4ec5316-300f-4095-b774-485c613db4d9. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:09:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cf38c281-11d4-484f-9ff9-c5a9b01de313 req-ee0ba7db-c12a-49d0-82cb-0894d042716b service nova] Acquiring lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:09:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cf38c281-11d4-484f-9ff9-c5a9b01de313 req-ee0ba7db-c12a-49d0-82cb-0894d042716b service nova] Acquired lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:09:28 user nova-compute[75285]: DEBUG nova.network.neutron [req-cf38c281-11d4-484f-9ff9-c5a9b01de313 req-ee0ba7db-c12a-49d0-82cb-0894d042716b service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing network info cache for port a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:09:28 user nova-compute[75285]: DEBUG nova.network.neutron [req-cf38c281-11d4-484f-9ff9-c5a9b01de313 req-ee0ba7db-c12a-49d0-82cb-0894d042716b service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:09:28 user nova-compute[75285]: DEBUG nova.network.neutron [None req-fe4b703c-4d75-4a58-b612-121c95b38d2f tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Updating instance_info_cache with network_info: [{"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:09:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe4b703c-4d75-4a58-b612-121c95b38d2f tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Releasing lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:09:28 user nova-compute[75285]: DEBUG nova.objects.instance [None req-fe4b703c-4d75-4a58-b612-121c95b38d2f tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'flavor' on Instance uuid 16f56b6b-f08d-4650-b0eb-a202662b0eb6 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:09:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:29 user nova-compute[75285]: DEBUG nova.objects.instance [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lazy-loading 'flavor' on Instance uuid e5fd224c-b34e-41b6-9bdf-28c88579b88c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:09:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bb6d14a5-28fe-4e69-a01c-2fda37ec44fa tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.777s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:29 user nova-compute[75285]: DEBUG nova.network.neutron [req-cf38c281-11d4-484f-9ff9-c5a9b01de313 req-ee0ba7db-c12a-49d0-82cb-0894d042716b service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:09:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cf38c281-11d4-484f-9ff9-c5a9b01de313 req-ee0ba7db-c12a-49d0-82cb-0894d042716b service nova] Releasing lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:09:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-276bfcdb-5cc1-4b16-92da-da052d9c9e66 req-09b99c4e-ddf5-4186-a9fb-cf84696d1b81 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-vif-unplugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-276bfcdb-5cc1-4b16-92da-da052d9c9e66 req-09b99c4e-ddf5-4186-a9fb-cf84696d1b81 service nova] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-276bfcdb-5cc1-4b16-92da-da052d9c9e66 req-09b99c4e-ddf5-4186-a9fb-cf84696d1b81 service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-276bfcdb-5cc1-4b16-92da-da052d9c9e66 req-09b99c4e-ddf5-4186-a9fb-cf84696d1b81 service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-276bfcdb-5cc1-4b16-92da-da052d9c9e66 req-09b99c4e-ddf5-4186-a9fb-cf84696d1b81 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] No waiting events found dispatching network-vif-unplugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:09:29 user nova-compute[75285]: WARNING nova.compute.manager [req-276bfcdb-5cc1-4b16-92da-da052d9c9e66 req-09b99c4e-ddf5-4186-a9fb-cf84696d1b81 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received unexpected event network-vif-unplugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:09:29 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Instance destroyed successfully.
Nov 10 21:09:29 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Successfully updated port: 2d4174d5-1be7-4753-a29c-a3ed22b4af19 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:09:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-28889119-2dca-42e5-8b2a-543f2994f5bf req-b033d055-ef0b-49a0-b842-1dfeb68e282d service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-changed-2d4174d5-1be7-4753-a29c-a3ed22b4af19 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-28889119-2dca-42e5-8b2a-543f2994f5bf req-b033d055-ef0b-49a0-b842-1dfeb68e282d service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing instance network info cache due to event network-changed-2d4174d5-1be7-4753-a29c-a3ed22b4af19. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:09:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-28889119-2dca-42e5-8b2a-543f2994f5bf req-b033d055-ef0b-49a0-b842-1dfeb68e282d service nova] Acquiring lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:09:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-28889119-2dca-42e5-8b2a-543f2994f5bf req-b033d055-ef0b-49a0-b842-1dfeb68e282d service nova] Acquired lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:09:30 user nova-compute[75285]: DEBUG nova.network.neutron [req-28889119-2dca-42e5-8b2a-543f2994f5bf req-b033d055-ef0b-49a0-b842-1dfeb68e282d service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing network info cache for port 2d4174d5-1be7-4753-a29c-a3ed22b4af19 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:09:30 user nova-compute[75285]: DEBUG nova.network.neutron [req-28889119-2dca-42e5-8b2a-543f2994f5bf req-b033d055-ef0b-49a0-b842-1dfeb68e282d service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:09:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:30 user nova-compute[75285]: DEBUG nova.network.neutron [req-28889119-2dca-42e5-8b2a-543f2994f5bf req-b033d055-ef0b-49a0-b842-1dfeb68e282d service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:09:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-28889119-2dca-42e5-8b2a-543f2994f5bf req-b033d055-ef0b-49a0-b842-1dfeb68e282d service nova] Releasing lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:09:30 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Successfully updated port: 72df5ae8-22f3-4870-993a-19137df8e682 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:09:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:31 user nova-compute[75285]: DEBUG nova.compute.manager [req-ea3ed620-bfe9-4beb-808b-8e9dd63bf29a req-43464cb4-5488-4e2f-a126-afcb46f57114 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ea3ed620-bfe9-4beb-808b-8e9dd63bf29a req-43464cb4-5488-4e2f-a126-afcb46f57114 service nova] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ea3ed620-bfe9-4beb-808b-8e9dd63bf29a req-43464cb4-5488-4e2f-a126-afcb46f57114 service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ea3ed620-bfe9-4beb-808b-8e9dd63bf29a req-43464cb4-5488-4e2f-a126-afcb46f57114 service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:31 user nova-compute[75285]: DEBUG nova.compute.manager [req-ea3ed620-bfe9-4beb-808b-8e9dd63bf29a req-43464cb4-5488-4e2f-a126-afcb46f57114 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] No waiting events found dispatching network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:09:31 user nova-compute[75285]: WARNING nova.compute.manager [req-ea3ed620-bfe9-4beb-808b-8e9dd63bf29a req-43464cb4-5488-4e2f-a126-afcb46f57114 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received unexpected event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:09:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:31 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Successfully updated port: fb52e593-077b-4368-93c0-aa9e1ad6717f {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-changed-72df5ae8-22f3-4870-993a-19137df8e682 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing instance network info cache due to event network-changed-72df5ae8-22f3-4870-993a-19137df8e682. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] Acquiring lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] Acquired lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG nova.network.neutron [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing network info cache for port 72df5ae8-22f3-4870-993a-19137df8e682 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG nova.network.neutron [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG nova.network.neutron [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] Releasing lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-changed-fb52e593-077b-4368-93c0-aa9e1ad6717f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing instance network info cache due to event network-changed-fb52e593-077b-4368-93c0-aa9e1ad6717f. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] Acquiring lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] Acquired lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG nova.network.neutron [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing network info cache for port fb52e593-077b-4368-93c0-aa9e1ad6717f {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Successfully updated port: e19633a5-3e53-4b50-8b33-ec86a745a45d {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:09:32 user nova-compute[75285]: DEBUG nova.network.neutron [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:09:33 user nova-compute[75285]: DEBUG nova.network.neutron [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:09:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c887378-3ac5-4a37-a8f8-3cd89d5040d6 req-d66a92b7-7b0b-43b6-aa52-747ba70cc7a5 service nova] Releasing lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:09:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-85bfd6ae-47ec-4d80-859d-58900a650492 req-a5803676-2a91-4f01-a738-d27913b17a39 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-85bfd6ae-47ec-4d80-859d-58900a650492 req-a5803676-2a91-4f01-a738-d27913b17a39 service nova] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-85bfd6ae-47ec-4d80-859d-58900a650492 req-a5803676-2a91-4f01-a738-d27913b17a39 service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-85bfd6ae-47ec-4d80-859d-58900a650492 req-a5803676-2a91-4f01-a738-d27913b17a39 service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-85bfd6ae-47ec-4d80-859d-58900a650492 req-a5803676-2a91-4f01-a738-d27913b17a39 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] No waiting events found dispatching network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:09:33 user nova-compute[75285]: WARNING nova.compute.manager [req-85bfd6ae-47ec-4d80-859d-58900a650492 req-a5803676-2a91-4f01-a738-d27913b17a39 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received unexpected event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:09:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-85bfd6ae-47ec-4d80-859d-58900a650492 req-a5803676-2a91-4f01-a738-d27913b17a39 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-85bfd6ae-47ec-4d80-859d-58900a650492 req-a5803676-2a91-4f01-a738-d27913b17a39 service nova] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-85bfd6ae-47ec-4d80-859d-58900a650492 req-a5803676-2a91-4f01-a738-d27913b17a39 service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-85bfd6ae-47ec-4d80-859d-58900a650492 req-a5803676-2a91-4f01-a738-d27913b17a39 service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-85bfd6ae-47ec-4d80-859d-58900a650492 req-a5803676-2a91-4f01-a738-d27913b17a39 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] No waiting events found dispatching network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:09:33 user nova-compute[75285]: WARNING nova.compute.manager [req-85bfd6ae-47ec-4d80-859d-58900a650492 req-a5803676-2a91-4f01-a738-d27913b17a39 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received unexpected event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:09:33 user nova-compute[75285]: DEBUG nova.compute.manager [None req-fe4b703c-4d75-4a58-b612-121c95b38d2f tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:09:33 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Successfully updated port: bd2b2398-97ca-4072-b5d8-905d2011fd16 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-changed-e19633a5-3e53-4b50-8b33-ec86a745a45d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing instance network info cache due to event network-changed-e19633a5-3e53-4b50-8b33-ec86a745a45d. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] Acquiring lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] Acquired lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing network info cache for port e19633a5-3e53-4b50-8b33-ec86a745a45d {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Successfully updated port: 3496e5b6-03c7-4c7b-9a71-932ed44c1b5e {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] Releasing lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-changed-bd2b2398-97ca-4072-b5d8-905d2011fd16 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing instance network info cache due to event network-changed-bd2b2398-97ca-4072-b5d8-905d2011fd16. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] Acquiring lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] Acquired lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing network info cache for port bd2b2398-97ca-4072-b5d8-905d2011fd16 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:09:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:09:35 user nova-compute[75285]: DEBUG nova.network.neutron [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:09:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7dfb14a9-8dab-470c-912a-19f48ea27550 req-32340f7f-0cdc-4f4f-91c4-5ed75a1fc809 service nova] Releasing lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:09:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquired lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:09:35 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:09:35 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:09:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-60c8645a-09a6-430c-8329-77d97e6d71c7 req-2cc2bc96-013e-4e62-85e8-bf3211b0d17a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-changed-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:09:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-60c8645a-09a6-430c-8329-77d97e6d71c7 req-2cc2bc96-013e-4e62-85e8-bf3211b0d17a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing instance network info cache due to event network-changed-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:09:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-60c8645a-09a6-430c-8329-77d97e6d71c7 req-2cc2bc96-013e-4e62-85e8-bf3211b0d17a service nova] Acquiring lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:09:36 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:09:36 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:09:37 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [{"id": "a4ec5316-300f-4095-b774-485c613db4d9", "address": "fa:16:3e:ae:bb:98", "network": {"id": "fe43178e-f9ea-4eb5-ae15-475ddd073359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562639401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec5316-30", "ovs_interfaceid": "a4ec5316-300f-4095-b774-485c613db4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "address": "fa:16:3e:36:33:41", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e593-07", "ovs_interfaceid": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "address": "fa:16:3e:e9:56:81", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19633a5-3e", "ovs_interfaceid": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "address": "fa:16:3e:9b:ac:12", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3496e5b6-03", "ovs_interfaceid": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:09:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Releasing lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:09:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Instance network_info: |[{"id": "a4ec5316-300f-4095-b774-485c613db4d9", "address": "fa:16:3e:ae:bb:98", "network": {"id": "fe43178e-f9ea-4eb5-ae15-475ddd073359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562639401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec5316-30", "ovs_interfaceid": "a4ec5316-300f-4095-b774-485c613db4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "address": "fa:16:3e:36:33:41", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e593-07", "ovs_interfaceid": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "address": "fa:16:3e:e9:56:81", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19633a5-3e", "ovs_interfaceid": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "address": "fa:16:3e:9b:ac:12", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3496e5b6-03", "ovs_interfaceid": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:09:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-60c8645a-09a6-430c-8329-77d97e6d71c7 req-2cc2bc96-013e-4e62-85e8-bf3211b0d17a service nova] Acquired lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:09:37 user nova-compute[75285]: DEBUG nova.network.neutron [req-60c8645a-09a6-430c-8329-77d97e6d71c7 req-2cc2bc96-013e-4e62-85e8-bf3211b0d17a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing network info cache for port 3496e5b6-03c7-4c7b-9a71-932ed44c1b5e {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:09:37 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:09:38 user nova-compute[75285]: DEBUG nova.network.neutron [req-60c8645a-09a6-430c-8329-77d97e6d71c7 req-2cc2bc96-013e-4e62-85e8-bf3211b0d17a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updated VIF entry in instance network info cache for port 3496e5b6-03c7-4c7b-9a71-932ed44c1b5e. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:09:38 user nova-compute[75285]: DEBUG nova.network.neutron [req-60c8645a-09a6-430c-8329-77d97e6d71c7 req-2cc2bc96-013e-4e62-85e8-bf3211b0d17a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [{"id": "a4ec5316-300f-4095-b774-485c613db4d9", "address": "fa:16:3e:ae:bb:98", "network": {"id": "fe43178e-f9ea-4eb5-ae15-475ddd073359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562639401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec5316-30", "ovs_interfaceid": "a4ec5316-300f-4095-b774-485c613db4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "address": "fa:16:3e:36:33:41", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e593-07", "ovs_interfaceid": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "address": "fa:16:3e:e9:56:81", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19633a5-3e", "ovs_interfaceid": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "address": "fa:16:3e:9b:ac:12", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3496e5b6-03", "ovs_interfaceid": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:09:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-60c8645a-09a6-430c-8329-77d97e6d71c7 req-2cc2bc96-013e-4e62-85e8-bf3211b0d17a service nova] Releasing lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:09:38 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:09:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:09:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:09:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Skipping network cache update for instance because it is Building. {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 21:09:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:09:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:09:38 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:09:38 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid 16f56b6b-f08d-4650-b0eb-a202662b0eb6 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:09:39 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Updating instance_info_cache with network_info: [{"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:09:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:09:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:09:39 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:09:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:41 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:09:41 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:09:41 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:09:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:09:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:09:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:45 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:09:45 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7627MB free_disk=25.44637680053711GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 02b4446d-1538-4e80-b93d-5cb904b7b98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 6db680e7-3e21-4451-a0b1-29f9eca59b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance e5fd224c-b34e-41b6-9bdf-28c88579b88c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 20cb91b5-2a74-4f99-adf9-0db04167d2e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 09ab2e54-1189-420e-9e5c-d158e4106ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 26bec53a-de52-4a18-b778-8f917cace2dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:09:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:09:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:48 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:09:48 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:09:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:50 user nova-compute[75285]: INFO nova.virt.block_device [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Booting with volume 17437102-0775-48a0-b172-b76e3225bcfc at /dev/vdb
Nov 10 21:09:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG os_brick.utils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc8ca49-570f-4382-bdf7-5514778cd2de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f4ed59-560b-482d-ae99-3bf332d84473]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7220e04d-757e-4a20-93d8-aa719ae019c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fe1435-f595-4b9b-836d-8e66366499b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:09:51 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:09:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13b8795-9704-4e95-a6b4-8d1f51a5336f]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG os_brick.utils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:09:51 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating existing volume attachment record: d59ba020-b6ff-4066-bf99-b4856b9a2085 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:09:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:09:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "3a0c67ef-1414-47e0-8769-c9164baf8993" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:10:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:09 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:10:09 user nova-compute[75285]: INFO nova.compute.claims [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Claim successful on node user
Nov 10 21:10:09 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:10:09 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:10:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:10:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:10:09 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:10:09 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:10:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:10:09 user nova-compute[75285]: DEBUG nova.policy [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '353cbd5fff0d4550b72b85c5073ae81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cea5dc310634b9da5042ae70e713b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:10 user nova-compute[75285]: INFO nova.compute.manager [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Terminating instance
Nov 10 21:10:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:10:10 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Creating image(s)
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "/opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "/opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.232s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.215s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk 1073741824" returned: 0 in 0.053s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Successfully created port: 361e6e85-04c1-41b7-8010-39456b498d6f {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.224s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:10 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Instance destroyed successfully.
Nov 10 21:10:10 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lazy-loading 'resources' on Instance uuid e5fd224c-b34e-41b6-9bdf-28c88579b88c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:06:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-596583512',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-596583512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5965835',id=11,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8mj0O7SuFS3Of7voBdcbC9vhOEgp1hnxiHCpWz8pannb/MGmzizQW3SJBl/Q7Ni1kBefsCDcRbw+YaxH7Q29H46+aek6hlPnKO4u5GVtUlIlL5naDhsRg8RLQKPyFB4w==',key_name='tempest-keypair-179669203',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:06:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04e9d9d42834478695c751849a9a8639',ramdisk_id='',reservation_id='r-ou2udife',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1023567829',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c0c28be2d29417c90be704cc34848c0',uuid=e5fd224c-b34e-41b6-9bdf-28c88579b88c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53a2c401-3191-4153-94dc-a43a90457023", "address": "fa:16:3e:2a:72:ba", "network": {"id": "84709e26-9628-447a-8a3b-699ba6d9eb33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-411333431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e9d9d42834478695c751849a9a8639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a2c401-31", "ovs_interfaceid": "53a2c401-3191-4153-94dc-a43a90457023", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Converting VIF {"id": "53a2c401-3191-4153-94dc-a43a90457023", "address": "fa:16:3e:2a:72:ba", "network": {"id": "84709e26-9628-447a-8a3b-699ba6d9eb33", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-411333431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e9d9d42834478695c751849a9a8639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a2c401-31", "ovs_interfaceid": "53a2c401-3191-4153-94dc-a43a90457023", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:72:ba,bridge_name='br-int',has_traffic_filtering=True,id=53a2c401-3191-4153-94dc-a43a90457023,network=Network(84709e26-9628-447a-8a3b-699ba6d9eb33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a2c401-31') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:10 user nova-compute[75285]: DEBUG os_vif [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:72:ba,bridge_name='br-int',has_traffic_filtering=True,id=53a2c401-3191-4153-94dc-a43a90457023,network=Network(84709e26-9628-447a-8a3b-699ba6d9eb33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a2c401-31') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53a2c401-31, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Cannot resize image /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Ensure instance console log exists: /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9c43622-c81b-483e-86f9-6bbd15365287) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:11 user nova-compute[75285]: INFO os_vif [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:72:ba,bridge_name='br-int',has_traffic_filtering=True,id=53a2c401-3191-4153-94dc-a43a90457023,network=Network(84709e26-9628-447a-8a3b-699ba6d9eb33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a2c401-31')
Nov 10 21:10:11 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Deleting instance files /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c_del
Nov 10 21:10:11 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Deletion of /opt/stack/data/nova/instances/e5fd224c-b34e-41b6-9bdf-28c88579b88c_del complete
Nov 10 21:10:11 user nova-compute[75285]: INFO nova.compute.manager [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 10 21:10:11 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Successfully updated port: 361e6e85-04c1-41b7-8010-39456b498d6f {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "refresh_cache-3a0c67ef-1414-47e0-8769-c9164baf8993" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquired lock "refresh_cache-3a0c67ef-1414-47e0-8769-c9164baf8993" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG nova.compute.manager [req-63cd3cbf-22ca-4f8a-adeb-2122b7ea5fff req-1ff2e8f8-f881-490f-9fa4-9575588e1ded service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Received event network-changed-361e6e85-04c1-41b7-8010-39456b498d6f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG nova.compute.manager [req-63cd3cbf-22ca-4f8a-adeb-2122b7ea5fff req-1ff2e8f8-f881-490f-9fa4-9575588e1ded service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Refreshing instance network info cache due to event network-changed-361e6e85-04c1-41b7-8010-39456b498d6f. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-63cd3cbf-22ca-4f8a-adeb-2122b7ea5fff req-1ff2e8f8-f881-490f-9fa4-9575588e1ded service nova] Acquiring lock "refresh_cache-3a0c67ef-1414-47e0-8769-c9164baf8993" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:10:11 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Updating instance_info_cache with network_info: [{"id": "361e6e85-04c1-41b7-8010-39456b498d6f", "address": "fa:16:3e:bd:d2:ae", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e6e85-04", "ovs_interfaceid": "361e6e85-04c1-41b7-8010-39456b498d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Releasing lock "refresh_cache-3a0c67ef-1414-47e0-8769-c9164baf8993" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Instance network_info: |[{"id": "361e6e85-04c1-41b7-8010-39456b498d6f", "address": "fa:16:3e:bd:d2:ae", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e6e85-04", "ovs_interfaceid": "361e6e85-04c1-41b7-8010-39456b498d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-63cd3cbf-22ca-4f8a-adeb-2122b7ea5fff req-1ff2e8f8-f881-490f-9fa4-9575588e1ded service nova] Acquired lock "refresh_cache-3a0c67ef-1414-47e0-8769-c9164baf8993" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.network.neutron [req-63cd3cbf-22ca-4f8a-adeb-2122b7ea5fff req-1ff2e8f8-f881-490f-9fa4-9575588e1ded service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Refreshing network info cache for port 361e6e85-04c1-41b7-8010-39456b498d6f {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Start _get_guest_xml network_info=[{"id": "361e6e85-04c1-41b7-8010-39456b498d6f", "address": "fa:16:3e:bd:d2:ae", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e6e85-04", "ovs_interfaceid": "361e6e85-04c1-41b7-8010-39456b498d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:10:12 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:10:12 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1994048602',display_name='tempest-ServersNegativeTestJSON-server-1994048602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1994048602',id=17,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cea5dc310634b9da5042ae70e713b1e',ramdisk_id='',reservation_id='r-pmygk2bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-957099376',owner_user_name='tempest-ServersNegativeTestJSON-957099376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:10:10Z,user_data=None,user_id='353cbd5fff0d4550b72b85c5073ae81d',uuid=3a0c67ef-1414-47e0-8769-c9164baf8993,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "361e6e85-04c1-41b7-8010-39456b498d6f", "address": "fa:16:3e:bd:d2:ae", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e6e85-04", "ovs_interfaceid": "361e6e85-04c1-41b7-8010-39456b498d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Converting VIF {"id": "361e6e85-04c1-41b7-8010-39456b498d6f", "address": "fa:16:3e:bd:d2:ae", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e6e85-04", "ovs_interfaceid": "361e6e85-04c1-41b7-8010-39456b498d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=361e6e85-04c1-41b7-8010-39456b498d6f,network=Network(28e1d97a-a55b-41d2-83d4-600aedcecb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e6e85-04') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.objects.instance [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a0c67ef-1414-47e0-8769-c9164baf8993 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:10:12 user nova-compute[75285]:   <uuid>3a0c67ef-1414-47e0-8769-c9164baf8993</uuid>
Nov 10 21:10:12 user nova-compute[75285]:   <name>instance-00000011</name>
Nov 10 21:10:12 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:10:12 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:10:12 user nova-compute[75285]:   <metadata>
Nov 10 21:10:12 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:10:12 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:10:12 user nova-compute[75285]:       <nova:name>tempest-ServersNegativeTestJSON-server-1994048602</nova:name>
Nov 10 21:10:12 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:10:12</nova:creationTime>
Nov 10 21:10:12 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:10:12 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:10:12 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:10:12 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:10:12 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:10:12 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:10:12 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:10:12 user nova-compute[75285]:       <nova:owner>
Nov 10 21:10:12 user nova-compute[75285]:         <nova:user uuid="353cbd5fff0d4550b72b85c5073ae81d">tempest-ServersNegativeTestJSON-957099376-project-member</nova:user>
Nov 10 21:10:12 user nova-compute[75285]:         <nova:project uuid="1cea5dc310634b9da5042ae70e713b1e">tempest-ServersNegativeTestJSON-957099376</nova:project>
Nov 10 21:10:12 user nova-compute[75285]:       </nova:owner>
Nov 10 21:10:12 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:10:12 user nova-compute[75285]:       <nova:ports>
Nov 10 21:10:12 user nova-compute[75285]:         <nova:port uuid="361e6e85-04c1-41b7-8010-39456b498d6f">
Nov 10 21:10:12 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 21:10:12 user nova-compute[75285]:         </nova:port>
Nov 10 21:10:12 user nova-compute[75285]:       </nova:ports>
Nov 10 21:10:12 user nova-compute[75285]:     </nova:instance>
Nov 10 21:10:12 user nova-compute[75285]:   </metadata>
Nov 10 21:10:12 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:10:12 user nova-compute[75285]:     <system>
Nov 10 21:10:12 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:10:12 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:10:12 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:10:12 user nova-compute[75285]:       <entry name="serial">3a0c67ef-1414-47e0-8769-c9164baf8993</entry>
Nov 10 21:10:12 user nova-compute[75285]:       <entry name="uuid">3a0c67ef-1414-47e0-8769-c9164baf8993</entry>
Nov 10 21:10:12 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:10:12 user nova-compute[75285]:     </system>
Nov 10 21:10:12 user nova-compute[75285]:   </sysinfo>
Nov 10 21:10:12 user nova-compute[75285]:   <os>
Nov 10 21:10:12 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:10:12 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:10:12 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:10:12 user nova-compute[75285]:   </os>
Nov 10 21:10:12 user nova-compute[75285]:   <features>
Nov 10 21:10:12 user nova-compute[75285]:     <acpi/>
Nov 10 21:10:12 user nova-compute[75285]:     <apic/>
Nov 10 21:10:12 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:10:12 user nova-compute[75285]:   </features>
Nov 10 21:10:12 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:10:12 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:10:12 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:10:12 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:10:12 user nova-compute[75285]:   </clock>
Nov 10 21:10:12 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:10:12 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:10:12 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:10:12 user nova-compute[75285]:   </cpu>
Nov 10 21:10:12 user nova-compute[75285]:   <devices>
Nov 10 21:10:12 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:10:12 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:10:12 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk"/>
Nov 10 21:10:12 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:10:12 user nova-compute[75285]:     </disk>
Nov 10 21:10:12 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:10:12 user nova-compute[75285]:       <mac address="fa:16:3e:bd:d2:ae"/>
Nov 10 21:10:12 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:10:12 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:10:12 user nova-compute[75285]:       <target dev="tap361e6e85-04"/>
Nov 10 21:10:12 user nova-compute[75285]:     </interface>
Nov 10 21:10:12 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:10:12 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/console.log" append="off"/>
Nov 10 21:10:12 user nova-compute[75285]:     </serial>
Nov 10 21:10:12 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:10:12 user nova-compute[75285]:     <video>
Nov 10 21:10:12 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:10:12 user nova-compute[75285]:     </video>
Nov 10 21:10:12 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:10:12 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:10:12 user nova-compute[75285]:     </rng>
Nov 10 21:10:12 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:10:12 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:10:12 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:10:12 user nova-compute[75285]:     </memballoon>
Nov 10 21:10:12 user nova-compute[75285]:   </devices>
Nov 10 21:10:12 user nova-compute[75285]: </domain>
Nov 10 21:10:12 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1994048602',display_name='tempest-ServersNegativeTestJSON-server-1994048602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1994048602',id=17,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cea5dc310634b9da5042ae70e713b1e',ramdisk_id='',reservation_id='r-pmygk2bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-957099376',owner_user_name='tempest-ServersNegativeTestJSON-957099376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:10:10Z,user_data=None,user_id='353cbd5fff0d4550b72b85c5073ae81d',uuid=3a0c67ef-1414-47e0-8769-c9164baf8993,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "361e6e85-04c1-41b7-8010-39456b498d6f", "address": "fa:16:3e:bd:d2:ae", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e6e85-04", "ovs_interfaceid": "361e6e85-04c1-41b7-8010-39456b498d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Converting VIF {"id": "361e6e85-04c1-41b7-8010-39456b498d6f", "address": "fa:16:3e:bd:d2:ae", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e6e85-04", "ovs_interfaceid": "361e6e85-04c1-41b7-8010-39456b498d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=361e6e85-04c1-41b7-8010-39456b498d6f,network=Network(28e1d97a-a55b-41d2-83d4-600aedcecb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e6e85-04') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG os_vif [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=361e6e85-04c1-41b7-8010-39456b498d6f,network=Network(28e1d97a-a55b-41d2-83d4-600aedcecb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e6e85-04') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '961b8216-640b-56f3-8aa2-9c7aaaf2caa8', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap361e6e85-04, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap361e6e85-04, col_values=(('qos', UUID('5d065f43-9c2f-4aaf-a986-1401850d2fec')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap361e6e85-04, col_values=(('external_ids', {'iface-id': '361e6e85-04c1-41b7-8010-39456b498d6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:d2:ae', 'vm-uuid': '3a0c67ef-1414-47e0-8769-c9164baf8993'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:12 user nova-compute[75285]: INFO os_vif [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=361e6e85-04c1-41b7-8010-39456b498d6f,network=Network(28e1d97a-a55b-41d2-83d4-600aedcecb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e6e85-04')
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] No VIF found with MAC fa:16:3e:bd:d2:ae, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:10:12 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Took 1.59 seconds to deallocate network for instance.
Nov 10 21:10:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:13 user nova-compute[75285]: DEBUG nova.network.neutron [req-63cd3cbf-22ca-4f8a-adeb-2122b7ea5fff req-1ff2e8f8-f881-490f-9fa4-9575588e1ded service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Updated VIF entry in instance network info cache for port 361e6e85-04c1-41b7-8010-39456b498d6f. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:10:13 user nova-compute[75285]: DEBUG nova.network.neutron [req-63cd3cbf-22ca-4f8a-adeb-2122b7ea5fff req-1ff2e8f8-f881-490f-9fa4-9575588e1ded service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Updating instance_info_cache with network_info: [{"id": "361e6e85-04c1-41b7-8010-39456b498d6f", "address": "fa:16:3e:bd:d2:ae", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e6e85-04", "ovs_interfaceid": "361e6e85-04c1-41b7-8010-39456b498d6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:10:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-63cd3cbf-22ca-4f8a-adeb-2122b7ea5fff req-1ff2e8f8-f881-490f-9fa4-9575588e1ded service nova] Releasing lock "refresh_cache-3a0c67ef-1414-47e0-8769-c9164baf8993" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:10:13 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:10:13 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:10:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:13 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Deleted allocations for instance e5fd224c-b34e-41b6-9bdf-28c88579b88c
Nov 10 21:10:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2f583c18-8abc-4f3f-b626-759efb7faef3 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829 tempest-TestServerVolumeAttachScenarioOldVersion-1023567829-project-member] Lock "e5fd224c-b34e-41b6-9bdf-28c88579b88c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.480s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-3a1d36b4-629b-4773-a61f-9b7f8391e2ca req-5be26c47-a568-435a-afce-c86f58f4d029 service nova] [instance: e5fd224c-b34e-41b6-9bdf-28c88579b88c] Received event network-vif-deleted-53a2c401-3191-4153-94dc-a43a90457023 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-c1ee04d9-9116-47a9-8629-fbee87fc9942 req-cbb06819-5dd1-42c2-8b0d-6297e743fa9b service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Received event network-vif-plugged-361e6e85-04c1-41b7-8010-39456b498d6f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c1ee04d9-9116-47a9-8629-fbee87fc9942 req-cbb06819-5dd1-42c2-8b0d-6297e743fa9b service nova] Acquiring lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c1ee04d9-9116-47a9-8629-fbee87fc9942 req-cbb06819-5dd1-42c2-8b0d-6297e743fa9b service nova] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c1ee04d9-9116-47a9-8629-fbee87fc9942 req-cbb06819-5dd1-42c2-8b0d-6297e743fa9b service nova] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-c1ee04d9-9116-47a9-8629-fbee87fc9942 req-cbb06819-5dd1-42c2-8b0d-6297e743fa9b service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] No waiting events found dispatching network-vif-plugged-361e6e85-04c1-41b7-8010-39456b498d6f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:14 user nova-compute[75285]: WARNING nova.compute.manager [req-c1ee04d9-9116-47a9-8629-fbee87fc9942 req-cbb06819-5dd1-42c2-8b0d-6297e743fa9b service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Received unexpected event network-vif-plugged-361e6e85-04c1-41b7-8010-39456b498d6f for instance with vm_state building and task_state spawning.
Nov 10 21:10:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:10:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:10:16 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Instance spawned successfully.
Nov 10 21:10:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:10:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:10:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:10:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:10:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:10:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:10:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:10:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-3be8ac46-4fb0-48d6-8c0b-874222b06a27 req-cce3f39a-aab6-466c-83af-e18e6a5b4a93 service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Received event network-vif-plugged-361e6e85-04c1-41b7-8010-39456b498d6f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3be8ac46-4fb0-48d6-8c0b-874222b06a27 req-cce3f39a-aab6-466c-83af-e18e6a5b4a93 service nova] Acquiring lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3be8ac46-4fb0-48d6-8c0b-874222b06a27 req-cce3f39a-aab6-466c-83af-e18e6a5b4a93 service nova] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3be8ac46-4fb0-48d6-8c0b-874222b06a27 req-cce3f39a-aab6-466c-83af-e18e6a5b4a93 service nova] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-3be8ac46-4fb0-48d6-8c0b-874222b06a27 req-cce3f39a-aab6-466c-83af-e18e6a5b4a93 service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] No waiting events found dispatching network-vif-plugged-361e6e85-04c1-41b7-8010-39456b498d6f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:16 user nova-compute[75285]: WARNING nova.compute.manager [req-3be8ac46-4fb0-48d6-8c0b-874222b06a27 req-cce3f39a-aab6-466c-83af-e18e6a5b4a93 service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Received unexpected event network-vif-plugged-361e6e85-04c1-41b7-8010-39456b498d6f for instance with vm_state building and task_state spawning.
Nov 10 21:10:16 user nova-compute[75285]: INFO nova.compute.manager [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Took 6.50 seconds to spawn the instance on the hypervisor.
Nov 10 21:10:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:10:16 user nova-compute[75285]: INFO nova.compute.manager [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Took 7.42 seconds to build instance.
Nov 10 21:10:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d37856a-d7e5-4bf5-94ab-d0ba96aaad3a tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.538s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:20 user nova-compute[75285]: INFO nova.virt.block_device [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Booting with volume bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 at /dev/vdc
Nov 10 21:10:20 user nova-compute[75285]: DEBUG os_brick.utils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c08f326-7175-4240-8138-6df7198f866c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[771221e9-8adb-410a-9de5-184f8daa0f1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4f8e13-0428-4c26-a543-3d4f90d3c08b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c849d9-3411-4324-97fe-f7b4f236ddd9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:10:20 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:10:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[399f24f0-9a1c-4caa-b215-e21196f2cdf3]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG os_brick.utils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:10:20 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating existing volume attachment record: 62a0c720-2902-492c-b70a-7b95fed383d6 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:10:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:28 user nova-compute[75285]: INFO nova.compute.manager [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Terminating instance
Nov 10 21:10:28 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-f00aae83-4f04-481e-a36d-87b1a05d1c89 req-6751d1af-f712-477e-9c29-8a91e6b8019b service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Received event network-vif-unplugged-6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f00aae83-4f04-481e-a36d-87b1a05d1c89 req-6751d1af-f712-477e-9c29-8a91e6b8019b service nova] Acquiring lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f00aae83-4f04-481e-a36d-87b1a05d1c89 req-6751d1af-f712-477e-9c29-8a91e6b8019b service nova] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f00aae83-4f04-481e-a36d-87b1a05d1c89 req-6751d1af-f712-477e-9c29-8a91e6b8019b service nova] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-f00aae83-4f04-481e-a36d-87b1a05d1c89 req-6751d1af-f712-477e-9c29-8a91e6b8019b service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] No waiting events found dispatching network-vif-unplugged-6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-f00aae83-4f04-481e-a36d-87b1a05d1c89 req-6751d1af-f712-477e-9c29-8a91e6b8019b service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Received event network-vif-unplugged-6335c90a-8b5b-4619-af6f-e420972d35d0 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:28 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Instance destroyed successfully.
Nov 10 21:10:28 user nova-compute[75285]: DEBUG nova.objects.instance [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lazy-loading 'resources' on Instance uuid 6db680e7-3e21-4451-a0b1-29f9eca59b2f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1603427953',display_name='tempest-VolumesAdminNegativeTest-server-1603427953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1603427953',id=4,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2O0huQTMv99HqkArDFlcTekmlYzR2YBg6tqwxXvXzeV+RBNnDTNpLhWJjvihsANa4hhE10kYsYg6080lB8Yryk0UyKVx0o83JoIfw73pKtuArg3+eR8hCu7nYcbvzoJg==',key_name='tempest-keypair-932573605',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:03:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfa427a4529a400b9f1067e756f7c681',ramdisk_id='',reservation_id='r-0v0l3g5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-554707513',owner_user_name='tempest-VolumesAdminNegativeTest-554707513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92fecbd1e3364a73a2b02edfba7e894e',uuid=6db680e7-3e21-4451-a0b1-29f9eca59b2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6335c90a-8b5b-4619-af6f-e420972d35d0", "address": "fa:16:3e:9b:b6:31", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6335c90a-8b", "ovs_interfaceid": "6335c90a-8b5b-4619-af6f-e420972d35d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Converting VIF {"id": "6335c90a-8b5b-4619-af6f-e420972d35d0", "address": "fa:16:3e:9b:b6:31", "network": {"id": "ed40fbcd-a68a-4582-805a-09cdd3206893", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2120677232-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfa427a4529a400b9f1067e756f7c681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6335c90a-8b", "ovs_interfaceid": "6335c90a-8b5b-4619-af6f-e420972d35d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:b6:31,bridge_name='br-int',has_traffic_filtering=True,id=6335c90a-8b5b-4619-af6f-e420972d35d0,network=Network(ed40fbcd-a68a-4582-805a-09cdd3206893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6335c90a-8b') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG os_vif [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:b6:31,bridge_name='br-int',has_traffic_filtering=True,id=6335c90a-8b5b-4619-af6f-e420972d35d0,network=Network(ed40fbcd-a68a-4582-805a-09cdd3206893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6335c90a-8b') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6335c90a-8b, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79ef1f79-c81a-4e0b-86b5-71591435b1af) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:29 user nova-compute[75285]: INFO os_vif [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:b6:31,bridge_name='br-int',has_traffic_filtering=True,id=6335c90a-8b5b-4619-af6f-e420972d35d0,network=Network(ed40fbcd-a68a-4582-805a-09cdd3206893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6335c90a-8b')
Nov 10 21:10:29 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Deleting instance files /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f_del
Nov 10 21:10:29 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Deletion of /opt/stack/data/nova/instances/6db680e7-3e21-4451-a0b1-29f9eca59b2f_del complete
Nov 10 21:10:29 user nova-compute[75285]: INFO nova.compute.manager [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 10 21:10:29 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:10:29 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:10:29 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:10:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-75556748-644c-45d2-890e-0283b0db89d3 req-158912a3-5a89-428b-b5bf-ecbdc12b570d service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Received event network-vif-plugged-6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-75556748-644c-45d2-890e-0283b0db89d3 req-158912a3-5a89-428b-b5bf-ecbdc12b570d service nova] Acquiring lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-75556748-644c-45d2-890e-0283b0db89d3 req-158912a3-5a89-428b-b5bf-ecbdc12b570d service nova] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-75556748-644c-45d2-890e-0283b0db89d3 req-158912a3-5a89-428b-b5bf-ecbdc12b570d service nova] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-75556748-644c-45d2-890e-0283b0db89d3 req-158912a3-5a89-428b-b5bf-ecbdc12b570d service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] No waiting events found dispatching network-vif-plugged-6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:30 user nova-compute[75285]: WARNING nova.compute.manager [req-75556748-644c-45d2-890e-0283b0db89d3 req-158912a3-5a89-428b-b5bf-ecbdc12b570d service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Received unexpected event network-vif-plugged-6335c90a-8b5b-4619-af6f-e420972d35d0 for instance with vm_state active and task_state deleting.
Nov 10 21:10:30 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:10:30 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Took 1.68 seconds to deallocate network for instance.
Nov 10 21:10:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-c902243f-8b1b-45f1-84fb-1a3e51ce8d51 req-2a72f1ff-ae5a-4ddd-8d7d-ee023534342f service nova] [instance: 6db680e7-3e21-4451-a0b1-29f9eca59b2f] Received event network-vif-deleted-6335c90a-8b5b-4619-af6f-e420972d35d0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:31 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:10:31 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:10:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:31 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Deleted allocations for instance 6db680e7-3e21-4451-a0b1-29f9eca59b2f
Nov 10 21:10:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5d59ac8a-0680-46f9-96cf-06720329370e tempest-VolumesAdminNegativeTest-554707513 tempest-VolumesAdminNegativeTest-554707513-project-member] Lock "6db680e7-3e21-4451-a0b1-29f9eca59b2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.268s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:35 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:10:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:37 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:10:38 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:10:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:40 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:10:40 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:10:40 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:10:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:10:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:10:40 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Updating instance_info_cache with network_info: [{"id": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "address": "fa:16:3e:d6:59:09", "network": {"id": "bb78092d-2ba8-42bd-862e-b697ef77a6ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958013330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d223d68b26463c93d4c8f203d5d597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d6abc5-af", "ovs_interfaceid": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-02b4446d-1538-4e80-b93d-5cb904b7b98f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Acquiring lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Acquiring lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:41 user nova-compute[75285]: INFO nova.compute.manager [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Terminating instance
Nov 10 21:10:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-9301ff90-a554-4ff8-8b03-c2ef401142df req-34fb2832-7753-4402-9fd1-40e984c08a01 service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Received event network-vif-unplugged-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9301ff90-a554-4ff8-8b03-c2ef401142df req-34fb2832-7753-4402-9fd1-40e984c08a01 service nova] Acquiring lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9301ff90-a554-4ff8-8b03-c2ef401142df req-34fb2832-7753-4402-9fd1-40e984c08a01 service nova] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9301ff90-a554-4ff8-8b03-c2ef401142df req-34fb2832-7753-4402-9fd1-40e984c08a01 service nova] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-9301ff90-a554-4ff8-8b03-c2ef401142df req-34fb2832-7753-4402-9fd1-40e984c08a01 service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] No waiting events found dispatching network-vif-unplugged-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-9301ff90-a554-4ff8-8b03-c2ef401142df req-34fb2832-7753-4402-9fd1-40e984c08a01 service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Received event network-vif-unplugged-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:10:42 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Instance destroyed successfully.
Nov 10 21:10:42 user nova-compute[75285]: DEBUG nova.objects.instance [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lazy-loading 'resources' on Instance uuid 02b4446d-1538-4e80-b93d-5cb904b7b98f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1042147122',display_name='tempest-ServerActionsTestOtherB-server-1042147122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1042147122',id=2,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHSVfWesCMN5U0w8FiBJhlrIgDuGfvpAydqXhPieWhctFEpGK1NUW04H0/zt6WHWlNh6c7ZSz2jhTT2OSBgKo9hTQDXn8yOjvrqcXJwcfzTMnYILFq9HCXRp4fxPC2pag==',key_name='tempest-keypair-2111708737',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:02:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11d223d68b26463c93d4c8f203d5d597',ramdisk_id='',reservation_id='r-o17p00dy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-216766959',owner_user_name='tempest-ServerActionsTestOtherB-216766959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6b0511ba054bf78ede21b9db18fe59',uuid=02b4446d-1538-4e80-b93d-5cb904b7b98f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "address": "fa:16:3e:d6:59:09", "network": {"id": "bb78092d-2ba8-42bd-862e-b697ef77a6ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958013330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d223d68b26463c93d4c8f203d5d597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d6abc5-af", "ovs_interfaceid": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Converting VIF {"id": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "address": "fa:16:3e:d6:59:09", "network": {"id": "bb78092d-2ba8-42bd-862e-b697ef77a6ef", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958013330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11d223d68b26463c93d4c8f203d5d597", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d6abc5-af", "ovs_interfaceid": "86d6abc5-af6c-4a7a-be0c-81dc149b5df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:59:09,bridge_name='br-int',has_traffic_filtering=True,id=86d6abc5-af6c-4a7a-be0c-81dc149b5df7,network=Network(bb78092d-2ba8-42bd-862e-b697ef77a6ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d6abc5-af') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG os_vif [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:59:09,bridge_name='br-int',has_traffic_filtering=True,id=86d6abc5-af6c-4a7a-be0c-81dc149b5df7,network=Network(bb78092d-2ba8-42bd-862e-b697ef77a6ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d6abc5-af') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86d6abc5-af, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d4d2504-295b-467f-8544-3ca1a5b719cf) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:42 user nova-compute[75285]: INFO os_vif [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:59:09,bridge_name='br-int',has_traffic_filtering=True,id=86d6abc5-af6c-4a7a-be0c-81dc149b5df7,network=Network(bb78092d-2ba8-42bd-862e-b697ef77a6ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d6abc5-af')
Nov 10 21:10:42 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Deleting instance files /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f_del
Nov 10 21:10:42 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Deletion of /opt/stack/data/nova/instances/02b4446d-1538-4e80-b93d-5cb904b7b98f_del complete
Nov 10 21:10:42 user nova-compute[75285]: INFO nova.compute.manager [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 10 21:10:42 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:10:43 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Took 1.11 seconds to deallocate network for instance.
Nov 10 21:10:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-f6df8db7-83e1-4ffb-8027-1db5a571b5b3 req-5f856dde-f002-4db2-92c7-acb162fdb47b service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Received event network-vif-deleted-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:43 user nova-compute[75285]: INFO nova.compute.manager [req-f6df8db7-83e1-4ffb-8027-1db5a571b5b3 req-5f856dde-f002-4db2-92c7-acb162fdb47b service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Neutron deleted interface 86d6abc5-af6c-4a7a-be0c-81dc149b5df7; detaching it from the instance and deleting it from the info cache
Nov 10 21:10:43 user nova-compute[75285]: DEBUG nova.network.neutron [req-f6df8db7-83e1-4ffb-8027-1db5a571b5b3 req-5f856dde-f002-4db2-92c7-acb162fdb47b service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-f6df8db7-83e1-4ffb-8027-1db5a571b5b3 req-5f856dde-f002-4db2-92c7-acb162fdb47b service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Detach interface failed, port_id=86d6abc5-af6c-4a7a-be0c-81dc149b5df7, reason: Instance 02b4446d-1538-4e80-b93d-5cb904b7b98f could not be found. {{(pid=75285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:10:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:43 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Deleted allocations for instance 02b4446d-1538-4e80-b93d-5cb904b7b98f
Nov 10 21:10:44 user nova-compute[75285]: DEBUG nova.compute.manager [req-5090ce67-9987-452a-967e-d74a69598c95 req-062dc129-7a11-4bc7-9a4d-62d2697cbade service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Received event network-vif-plugged-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5090ce67-9987-452a-967e-d74a69598c95 req-062dc129-7a11-4bc7-9a4d-62d2697cbade service nova] Acquiring lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5090ce67-9987-452a-967e-d74a69598c95 req-062dc129-7a11-4bc7-9a4d-62d2697cbade service nova] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5090ce67-9987-452a-967e-d74a69598c95 req-062dc129-7a11-4bc7-9a4d-62d2697cbade service nova] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG nova.compute.manager [req-5090ce67-9987-452a-967e-d74a69598c95 req-062dc129-7a11-4bc7-9a4d-62d2697cbade service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] No waiting events found dispatching network-vif-plugged-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:44 user nova-compute[75285]: WARNING nova.compute.manager [req-5090ce67-9987-452a-967e-d74a69598c95 req-062dc129-7a11-4bc7-9a4d-62d2697cbade service nova] [instance: 02b4446d-1538-4e80-b93d-5cb904b7b98f] Received unexpected event network-vif-plugged-86d6abc5-af6c-4a7a-be0c-81dc149b5df7 for instance with vm_state deleted and task_state None.
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc825483-5f5a-44cf-b85c-6d4f874e2ea7 tempest-ServerActionsTestOtherB-216766959 tempest-ServerActionsTestOtherB-216766959-project-member] Lock "02b4446d-1538-4e80-b93d-5cb904b7b98f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.468s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:44 user nova-compute[75285]: INFO nova.compute.manager [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] instance snapshotting
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Beginning live snapshot process
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json -f qcow2 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json -f qcow2 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:44 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Error from libvirt while getting description of instance-00000002: [Error Code 42] Domain not found: no domain with matching uuid '02b4446d-1538-4e80-b93d-5cb904b7b98f' (instance-00000002): libvirt.libvirtError: Domain not found: no domain with matching uuid '02b4446d-1538-4e80-b93d-5cb904b7b98f' (instance-00000002)
Nov 10 21:10:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.427s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1vyg5qxu/b6036c8a914f4c28b4736bdd321b7206.delta 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:45 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:10:45 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:10:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8059MB free_disk=25.452259063720703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1vyg5qxu/b6036c8a914f4c28b4736bdd321b7206.delta 1073741824" returned: 0 in 0.062s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:45 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 21:10:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 20cb91b5-2a74-4f99-adf9-0db04167d2e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 09ab2e54-1189-420e-9e5c-d158e4106ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 26bec53a-de52-4a18-b778-8f917cace2dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3a0c67ef-1414-47e0-8769-c9164baf8993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:10:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:10:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:10:46 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 21:10:46 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:10:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1vyg5qxu/b6036c8a914f4c28b4736bdd321b7206.delta /opt/stack/data/nova/instances/snapshots/tmp1vyg5qxu/b6036c8a914f4c28b4736bdd321b7206 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1vyg5qxu/b6036c8a914f4c28b4736bdd321b7206.delta /opt/stack/data/nova/instances/snapshots/tmp1vyg5qxu/b6036c8a914f4c28b4736bdd321b7206" returned: 0 in 0.463s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:47 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Snapshot extracted, beginning image upload
Nov 10 21:10:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:10:47 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Creating image(s)
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Did not create local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Ensure instance console log exists: /opt/stack/data/nova/instances/26bec53a-de52-4a18-b778-8f917cace2dd/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Start _get_guest_xml network_info=[{"id": "a4ec5316-300f-4095-b774-485c613db4d9", "address": "fa:16:3e:ae:bb:98", "network": {"id": "fe43178e-f9ea-4eb5-ae15-475ddd073359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562639401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec5316-30", "ovs_interfaceid": "a4ec5316-300f-4095-b774-485c613db4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "address": "fa:16:3e:36:33:41", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e593-07", "ovs_interfaceid": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "address": "fa:16:3e:e9:56:81", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19633a5-3e", "ovs_interfaceid": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "address": "fa:16:3e:9b:ac:12", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3496e5b6-03", "ovs_interfaceid": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '1198f1e1-c2e7-4ba4-9f9b-9cc70ddcd8a6', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUiHXWxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26bec53a-de52-4a18-b778-8f917cace2dd', 'attached_at': '', 'detached_at': '', 'volume_id': '64430c41-05b2-4af5-8bd9-fb3888479da8', 'serial': '64430c41-05b2-4af5-8bd9-fb3888479da8'}, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'd59ba020-b6ff-4066-bf99-b4856b9a2085', 'boot_index': 1, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BIEknORH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26bec53a-de52-4a18-b778-8f917cace2dd', 'attached_at': '', 'detached_at': '', 'volume_id': '17437102-0775-48a0-b172-b76e3225bcfc', 'serial': '17437102-0775-48a0-b172-b76e3225bcfc'}, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '62a0c720-2902-492c-b70a-7b95fed383d6', 'boot_index': 2, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCwJboqv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26bec53a-de52-4a18-b778-8f917cace2dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'bfc2e782-14e0-426f-8a4e-5ac4a032bcc5', 'serial': 'bfc2e782-14e0-426f-8a4e-5ac4a032bcc5'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:10:47 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:10:47 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUiHXWxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:10:47 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:10:47 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:10:47 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[55331f38-af54-4f5d-a7e5-37ffc2f9cc2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:10:47 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b10eae-edec-4403-8306-ec7ca14d80c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8] added
Nov 10 21:10:47 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05ad0d2-95bd-41d5-aa07-ca08ca16fe27]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3666d052-050c-471b-9363-4bdef0bb9728]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUiHXWxF {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUiHXWxF" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6e5805-1513-4708-b123-055b95a193f8]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUiHXWxF'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81986f2-c00e-4f40-9d3a-3d01cc3d3d3f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bec9a14-583d-48de-8817-8db22553ce39]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:10:47 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:10:47 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3c69a0-2053-459d-b71b-570b09c8b0a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8, portal: 172.16.0.220,3260]
Nov 10 21:10:47 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8, portal: 172.16.0.220,3260] successful.
Nov 10 21:10:47 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea9eb8a-626d-4524-96a6-0f1b5703cdd2]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[571c66f7-ca53-49ab-814e-fa50c3790973]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:10:47 user nova-compute[75285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)
Nov 10 21:10:47 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:10:47 user nova-compute[75285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)
Nov 10 21:10:47 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[69157d7f-b4a8-4e31-abe6-8f76473186a2]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:10:47 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUiHXWxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23861353734633730', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861353734633730', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BIEknORH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:10:48 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:10:48 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:10:48 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1680eb-3add-4613-b3d5-97a47bc768ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:10:48 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47b2aa3-da05-4a59-a363-08edcbdcbd60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc] added
Nov 10 21:10:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecef5bbd-a094-4aba-b577-8bcfa8f54d67]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f01d35-ce66-4b2f-a8fb-4e7baed595f5]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BIEknORH {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BIEknORH" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d168bb90-7bb6-4d55-a34c-780942d067d8]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BIEknORH'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d14f6c-4b88-4580-8247-15ea4601a55b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f235637-d566-4ef7-aae6-09e7d05da9bc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:10:48 user nova-compute[75285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)
Nov 10 21:10:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:10:48 user nova-compute[75285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)
Nov 10 21:10:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e9dafc-83e8-4030-9bd1-a50f283109b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc, portal: 172.16.0.220,3260]
Nov 10 21:10:48 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc, portal: 172.16.0.220,3260] successful.
Nov 10 21:10:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2e75ce-d587-4d10-97d0-2296b98c4b45]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda263af-ab61-4bb8-8995-abe64ea9ac91]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:10:48 user nova-compute[75285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)
Nov 10 21:10:48 user nova-compute[75285]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)
Nov 10 21:10:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:10:48 user nova-compute[75285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)
Nov 10 21:10:48 user nova-compute[75285]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)
Nov 10 21:10:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:10:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:49 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf592310-da50-43f3-aca8-6a990e172f86]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:49 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:10:49 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BIEknORH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26331353033633335', 'path': '/dev/sdd'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331353033633335', 'path': '/dev/sdd'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCwJboqv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:10:50 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:10:50 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:10:50 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af8858f-c979-4c26-9749-a21f308f6024]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:10:50 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78edd91-a931-4906-8120-2c4397187cc6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5] added
Nov 10 21:10:50 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[19263c74-d3c2-46e8-9b25-1ea6e39b2cdd]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f084f1-86d3-4160-96a0-20a1271194d3]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCwJboqv {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCwJboqv" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2628596c-fbc2-452f-a051-c18d53b54eb9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dCwJboqv'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc58a39-da08-48e8-8c12-8cc4d5810714]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ac411a-03bc-441d-8e19-11850aa4bc8b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:10:50 user nova-compute[75285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)
Nov 10 21:10:50 user nova-compute[75285]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)
Nov 10 21:10:50 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:10:50 user nova-compute[75285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)
Nov 10 21:10:50 user nova-compute[75285]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)
Nov 10 21:10:50 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[080e676f-add1-415d-a628-e84fe6702de7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5, portal: 172.16.0.220,3260]
Nov 10 21:10:50 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5, portal: 172.16.0.220,3260] successful.
Nov 10 21:10:50 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[807656df-e7d0-40c4-9c67-8024d05258fc]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[16995b37-2149-476b-b583-c5476e62fa64]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:10:50 user nova-compute[75285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)
Nov 10 21:10:50 user nova-compute[75285]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)
Nov 10 21:10:50 user nova-compute[75285]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)
Nov 10 21:10:50 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:10:50 user nova-compute[75285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)
Nov 10 21:10:50 user nova-compute[75285]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)
Nov 10 21:10:50 user nova-compute[75285]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)
Nov 10 21:10:50 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb29542-9721-40ff-8332-da217e0f28ca]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:50 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:10:50 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Snapshot image upload complete
Nov 10 21:10:50 user nova-compute[75285]: INFO nova.compute.manager [None req-f0278c94-8f97-4460-bc78-353178aacf5d tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Took 6.32 seconds to snapshot the instance on the hypervisor.
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCwJboqv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23436366437396632', 'path': '/dev/sde'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436366437396632', 'path': '/dev/sde'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4ec5316-300f-4095-b774-485c613db4d9", "address": "fa:16:3e:ae:bb:98", "network": {"id": "fe43178e-f9ea-4eb5-ae15-475ddd073359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562639401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec5316-30", "ovs_interfaceid": "a4ec5316-300f-4095-b774-485c613db4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "a4ec5316-300f-4095-b774-485c613db4d9", "address": "fa:16:3e:ae:bb:98", "network": {"id": "fe43178e-f9ea-4eb5-ae15-475ddd073359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562639401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec5316-30", "ovs_interfaceid": "a4ec5316-300f-4095-b774-485c613db4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:bb:98,bridge_name='br-int',has_traffic_filtering=True,id=a4ec5316-300f-4095-b774-485c613db4d9,network=Network(fe43178e-f9ea-4eb5-ae15-475ddd073359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ec5316-30') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:75:63,bridge_name='br-int',has_traffic_filtering=True,id=2d4174d5-1be7-4753-a29c-a3ed22b4af19,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d4174d5-1b') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:11:6a,bridge_name='br-int',has_traffic_filtering=True,id=72df5ae8-22f3-4870-993a-19137df8e682,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72df5ae8-22') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "address": "fa:16:3e:36:33:41", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e593-07", "ovs_interfaceid": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "address": "fa:16:3e:36:33:41", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e593-07", "ovs_interfaceid": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:33:41,bridge_name='br-int',has_traffic_filtering=True,id=fb52e593-077b-4368-93c0-aa9e1ad6717f,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb52e593-07') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "address": "fa:16:3e:e9:56:81", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19633a5-3e", "ovs_interfaceid": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "address": "fa:16:3e:e9:56:81", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19633a5-3e", "ovs_interfaceid": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:56:81,bridge_name='br-int',has_traffic_filtering=True,id=e19633a5-3e53-4b50-8b33-ec86a745a45d,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape19633a5-3e') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:bf:eb,bridge_name='br-int',has_traffic_filtering=True,id=bd2b2398-97ca-4072-b5d8-905d2011fd16,network=Network(f1c2109f-a578-4e2a-86ae-7b6451db9280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd2b2398-97') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "address": "fa:16:3e:9b:ac:12", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3496e5b6-03", "ovs_interfaceid": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "address": "fa:16:3e:9b:ac:12", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3496e5b6-03", "ovs_interfaceid": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=3496e5b6-03c7-4c7b-9a71-932ed44c1b5e,network=Network(f1c2109f-a578-4e2a-86ae-7b6451db9280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3496e5b6-03') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.objects.instance [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lazy-loading 'pci_devices' on Instance uuid 26bec53a-de52-4a18-b778-8f917cace2dd {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:10:51 user nova-compute[75285]:   <uuid>26bec53a-de52-4a18-b778-8f917cace2dd</uuid>
Nov 10 21:10:51 user nova-compute[75285]:   <name>instance-00000010</name>
Nov 10 21:10:51 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:10:51 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:10:51 user nova-compute[75285]:   <metadata>
Nov 10 21:10:51 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:10:51 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:10:51 user nova-compute[75285]:       <nova:name>tempest-device-tagging-server-108163155</nova:name>
Nov 10 21:10:51 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:10:47</nova:creationTime>
Nov 10 21:10:51 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:10:51 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:10:51 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:10:51 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:10:51 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:10:51 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:10:51 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:10:51 user nova-compute[75285]:       <nova:owner>
Nov 10 21:10:51 user nova-compute[75285]:         <nova:user uuid="934f46eb81fc4e1fb900b25a7e9500c5">tempest-TaggedBootDevicesTest-529276018-project-member</nova:user>
Nov 10 21:10:51 user nova-compute[75285]:         <nova:project uuid="415f8f5d956148b7ad22cd31c04ceb37">tempest-TaggedBootDevicesTest-529276018</nova:project>
Nov 10 21:10:51 user nova-compute[75285]:       </nova:owner>
Nov 10 21:10:51 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:10:51 user nova-compute[75285]:       <nova:ports>
Nov 10 21:10:51 user nova-compute[75285]:         <nova:port uuid="a4ec5316-300f-4095-b774-485c613db4d9">
Nov 10 21:10:51 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 21:10:51 user nova-compute[75285]:         </nova:port>
Nov 10 21:10:51 user nova-compute[75285]:         <nova:port uuid="2d4174d5-1be7-4753-a29c-a3ed22b4af19">
Nov 10 21:10:51 user nova-compute[75285]:           <nova:ip type="fixed" address="10.1.1.150" ipVersion="4"/>
Nov 10 21:10:51 user nova-compute[75285]:         </nova:port>
Nov 10 21:10:51 user nova-compute[75285]:         <nova:port uuid="72df5ae8-22f3-4870-993a-19137df8e682">
Nov 10 21:10:51 user nova-compute[75285]:           <nova:ip type="fixed" address="10.1.1.227" ipVersion="4"/>
Nov 10 21:10:51 user nova-compute[75285]:         </nova:port>
Nov 10 21:10:51 user nova-compute[75285]:         <nova:port uuid="fb52e593-077b-4368-93c0-aa9e1ad6717f">
Nov 10 21:10:51 user nova-compute[75285]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Nov 10 21:10:51 user nova-compute[75285]:         </nova:port>
Nov 10 21:10:51 user nova-compute[75285]:         <nova:port uuid="e19633a5-3e53-4b50-8b33-ec86a745a45d">
Nov 10 21:10:51 user nova-compute[75285]:           <nova:ip type="fixed" address="10.1.1.94" ipVersion="4"/>
Nov 10 21:10:51 user nova-compute[75285]:         </nova:port>
Nov 10 21:10:51 user nova-compute[75285]:         <nova:port uuid="bd2b2398-97ca-4072-b5d8-905d2011fd16">
Nov 10 21:10:51 user nova-compute[75285]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 10 21:10:51 user nova-compute[75285]:         </nova:port>
Nov 10 21:10:51 user nova-compute[75285]:         <nova:port uuid="3496e5b6-03c7-4c7b-9a71-932ed44c1b5e">
Nov 10 21:10:51 user nova-compute[75285]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 10 21:10:51 user nova-compute[75285]:         </nova:port>
Nov 10 21:10:51 user nova-compute[75285]:       </nova:ports>
Nov 10 21:10:51 user nova-compute[75285]:     </nova:instance>
Nov 10 21:10:51 user nova-compute[75285]:   </metadata>
Nov 10 21:10:51 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:10:51 user nova-compute[75285]:     <system>
Nov 10 21:10:51 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:10:51 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:10:51 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:10:51 user nova-compute[75285]:       <entry name="serial">26bec53a-de52-4a18-b778-8f917cace2dd</entry>
Nov 10 21:10:51 user nova-compute[75285]:       <entry name="uuid">26bec53a-de52-4a18-b778-8f917cace2dd</entry>
Nov 10 21:10:51 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:10:51 user nova-compute[75285]:     </system>
Nov 10 21:10:51 user nova-compute[75285]:   </sysinfo>
Nov 10 21:10:51 user nova-compute[75285]:   <os>
Nov 10 21:10:51 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:10:51 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:10:51 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:10:51 user nova-compute[75285]:   </os>
Nov 10 21:10:51 user nova-compute[75285]:   <features>
Nov 10 21:10:51 user nova-compute[75285]:     <acpi/>
Nov 10 21:10:51 user nova-compute[75285]:     <apic/>
Nov 10 21:10:51 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:10:51 user nova-compute[75285]:   </features>
Nov 10 21:10:51 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:10:51 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:10:51 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:10:51 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:10:51 user nova-compute[75285]:   </clock>
Nov 10 21:10:51 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:10:51 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:10:51 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:10:51 user nova-compute[75285]:   </cpu>
Nov 10 21:10:51 user nova-compute[75285]:   <devices>
Nov 10 21:10:51 user nova-compute[75285]:     <disk type="file" device="cdrom">
Nov 10 21:10:51 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 21:10:51 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/26bec53a-de52-4a18-b778-8f917cace2dd/disk.config"/>
Nov 10 21:10:51 user nova-compute[75285]:       <target dev="hda" bus="ide"/>
Nov 10 21:10:51 user nova-compute[75285]:     </disk>
Nov 10 21:10:51 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:10:51 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:10:51 user nova-compute[75285]:       <source dev="/dev/sdb"/>
Nov 10 21:10:51 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:10:51 user nova-compute[75285]:       <serial>64430c41-05b2-4af5-8bd9-fb3888479da8</serial>
Nov 10 21:10:51 user nova-compute[75285]:     </disk>
Nov 10 21:10:51 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:10:51 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:10:51 user nova-compute[75285]:       <source dev="/dev/sdd"/>
Nov 10 21:10:51 user nova-compute[75285]:       <target dev="vdb" bus="virtio"/>
Nov 10 21:10:51 user nova-compute[75285]:       <serial>17437102-0775-48a0-b172-b76e3225bcfc</serial>
Nov 10 21:10:51 user nova-compute[75285]:     </disk>
Nov 10 21:10:51 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:10:51 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:10:51 user nova-compute[75285]:       <source dev="/dev/sde"/>
Nov 10 21:10:51 user nova-compute[75285]:       <target dev="vdc" bus="virtio"/>
Nov 10 21:10:51 user nova-compute[75285]:       <serial>bfc2e782-14e0-426f-8a4e-5ac4a032bcc5</serial>
Nov 10 21:10:51 user nova-compute[75285]:     </disk>
Nov 10 21:10:51 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:10:51 user nova-compute[75285]:       <mac address="fa:16:3e:ae:bb:98"/>
Nov 10 21:10:51 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:10:51 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:10:51 user nova-compute[75285]:       <target dev="tapa4ec5316-30"/>
Nov 10 21:10:51 user nova-compute[75285]:     </interface>
Nov 10 21:10:51 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:10:51 user nova-compute[75285]:       <mac address="fa:16:3e:6f:75:63"/>
Nov 10 21:10:51 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:10:51 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:10:51 user nova-compute[75285]:       <target dev="tap2d4174d5-1b"/>
Nov 10 21:10:51 user nova-compute[75285]:     </interface>
Nov 10 21:10:51 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:10:51 user nova-compute[75285]:       <mac address="fa:16:3e:4a:11:6a"/>
Nov 10 21:10:51 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:10:51 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:10:51 user nova-compute[75285]:       <target dev="tap72df5ae8-22"/>
Nov 10 21:10:51 user nova-compute[75285]:     </interface>
Nov 10 21:10:51 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:10:51 user nova-compute[75285]:       <mac address="fa:16:3e:36:33:41"/>
Nov 10 21:10:51 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:10:51 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:10:51 user nova-compute[75285]:       <target dev="tapfb52e593-07"/>
Nov 10 21:10:51 user nova-compute[75285]:     </interface>
Nov 10 21:10:51 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:10:51 user nova-compute[75285]:       <mac address="fa:16:3e:e9:56:81"/>
Nov 10 21:10:51 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:10:51 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:10:51 user nova-compute[75285]:       <target dev="tape19633a5-3e"/>
Nov 10 21:10:51 user nova-compute[75285]:     </interface>
Nov 10 21:10:51 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:10:51 user nova-compute[75285]:       <mac address="fa:16:3e:01:bf:eb"/>
Nov 10 21:10:51 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:10:51 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:10:51 user nova-compute[75285]:       <target dev="tapbd2b2398-97"/>
Nov 10 21:10:51 user nova-compute[75285]:     </interface>
Nov 10 21:10:51 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:10:51 user nova-compute[75285]:       <mac address="fa:16:3e:9b:ac:12"/>
Nov 10 21:10:51 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:10:51 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:10:51 user nova-compute[75285]:       <target dev="tap3496e5b6-03"/>
Nov 10 21:10:51 user nova-compute[75285]:     </interface>
Nov 10 21:10:51 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:10:51 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/26bec53a-de52-4a18-b778-8f917cace2dd/console.log" append="off"/>
Nov 10 21:10:51 user nova-compute[75285]:     </serial>
Nov 10 21:10:51 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:10:51 user nova-compute[75285]:     <video>
Nov 10 21:10:51 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:10:51 user nova-compute[75285]:     </video>
Nov 10 21:10:51 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:10:51 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:10:51 user nova-compute[75285]:     </rng>
Nov 10 21:10:51 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:10:51 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:10:51 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:10:51 user nova-compute[75285]:     </memballoon>
Nov 10 21:10:51 user nova-compute[75285]:   </devices>
Nov 10 21:10:51 user nova-compute[75285]: </domain>
Nov 10 21:10:51 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4ec5316-300f-4095-b774-485c613db4d9", "address": "fa:16:3e:ae:bb:98", "network": {"id": "fe43178e-f9ea-4eb5-ae15-475ddd073359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562639401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec5316-30", "ovs_interfaceid": "a4ec5316-300f-4095-b774-485c613db4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "a4ec5316-300f-4095-b774-485c613db4d9", "address": "fa:16:3e:ae:bb:98", "network": {"id": "fe43178e-f9ea-4eb5-ae15-475ddd073359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562639401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec5316-30", "ovs_interfaceid": "a4ec5316-300f-4095-b774-485c613db4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:bb:98,bridge_name='br-int',has_traffic_filtering=True,id=a4ec5316-300f-4095-b774-485c613db4d9,network=Network(fe43178e-f9ea-4eb5-ae15-475ddd073359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ec5316-30') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG os_vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:bb:98,bridge_name='br-int',has_traffic_filtering=True,id=a4ec5316-300f-4095-b774-485c613db4d9,network=Network(fe43178e-f9ea-4eb5-ae15-475ddd073359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ec5316-30') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74fcb716-3158-542c-8235-0f85de3ee50b', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4ec5316-30, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4ec5316-30, col_values=(('qos', UUID('98ccfb4d-edb8-434d-be08-4640fccb4c17')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4ec5316-30, col_values=(('external_ids', {'iface-id': 'a4ec5316-300f-4095-b774-485c613db4d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:bb:98', 'vm-uuid': '26bec53a-de52-4a18-b778-8f917cace2dd'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: INFO os_vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:bb:98,bridge_name='br-int',has_traffic_filtering=True,id=a4ec5316-300f-4095-b774-485c613db4d9,network=Network(fe43178e-f9ea-4eb5-ae15-475ddd073359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ec5316-30')
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:75:63,bridge_name='br-int',has_traffic_filtering=True,id=2d4174d5-1be7-4753-a29c-a3ed22b4af19,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d4174d5-1b') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG os_vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:75:63,bridge_name='br-int',has_traffic_filtering=True,id=2d4174d5-1be7-4753-a29c-a3ed22b4af19,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d4174d5-1b') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '752d55d0-2842-5fcd-a6b7-8b24b4ce37c2', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d4174d5-1b, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d4174d5-1b, col_values=(('qos', UUID('54fccf6e-36bb-4fd6-9d0b-3af35590fcc7')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d4174d5-1b, col_values=(('external_ids', {'iface-id': '2d4174d5-1be7-4753-a29c-a3ed22b4af19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:75:63', 'vm-uuid': '26bec53a-de52-4a18-b778-8f917cace2dd'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: INFO os_vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:75:63,bridge_name='br-int',has_traffic_filtering=True,id=2d4174d5-1be7-4753-a29c-a3ed22b4af19,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d4174d5-1b')
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:11:6a,bridge_name='br-int',has_traffic_filtering=True,id=72df5ae8-22f3-4870-993a-19137df8e682,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72df5ae8-22') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG os_vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:11:6a,bridge_name='br-int',has_traffic_filtering=True,id=72df5ae8-22f3-4870-993a-19137df8e682,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72df5ae8-22') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b45c3195-072e-52e8-afb0-101f2ca510b2', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72df5ae8-22, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72df5ae8-22, col_values=(('qos', UUID('a464c17c-4bae-4293-9c46-aebab671635a')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72df5ae8-22, col_values=(('external_ids', {'iface-id': '72df5ae8-22f3-4870-993a-19137df8e682', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:11:6a', 'vm-uuid': '26bec53a-de52-4a18-b778-8f917cace2dd'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: INFO os_vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:11:6a,bridge_name='br-int',has_traffic_filtering=True,id=72df5ae8-22f3-4870-993a-19137df8e682,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72df5ae8-22')
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "address": "fa:16:3e:36:33:41", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e593-07", "ovs_interfaceid": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "address": "fa:16:3e:36:33:41", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e593-07", "ovs_interfaceid": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:33:41,bridge_name='br-int',has_traffic_filtering=True,id=fb52e593-077b-4368-93c0-aa9e1ad6717f,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb52e593-07') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG os_vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:33:41,bridge_name='br-int',has_traffic_filtering=True,id=fb52e593-077b-4368-93c0-aa9e1ad6717f,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb52e593-07') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eabc9979-e579-5c3d-a729-4931245fd45f', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb52e593-07, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb52e593-07, col_values=(('qos', UUID('6a3b97e5-9648-47b7-81e1-4a0ae4b72428')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb52e593-07, col_values=(('external_ids', {'iface-id': 'fb52e593-077b-4368-93c0-aa9e1ad6717f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:33:41', 'vm-uuid': '26bec53a-de52-4a18-b778-8f917cace2dd'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: INFO os_vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:33:41,bridge_name='br-int',has_traffic_filtering=True,id=fb52e593-077b-4368-93c0-aa9e1ad6717f,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb52e593-07')
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "address": "fa:16:3e:e9:56:81", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19633a5-3e", "ovs_interfaceid": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "address": "fa:16:3e:e9:56:81", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19633a5-3e", "ovs_interfaceid": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:56:81,bridge_name='br-int',has_traffic_filtering=True,id=e19633a5-3e53-4b50-8b33-ec86a745a45d,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape19633a5-3e') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG os_vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:56:81,bridge_name='br-int',has_traffic_filtering=True,id=e19633a5-3e53-4b50-8b33-ec86a745a45d,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape19633a5-3e') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1713af8-ec5a-565f-878b-1cd27da76507', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape19633a5-3e, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape19633a5-3e, col_values=(('qos', UUID('1a23a667-748c-446f-be56-5259f4ab5776')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape19633a5-3e, col_values=(('external_ids', {'iface-id': 'e19633a5-3e53-4b50-8b33-ec86a745a45d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:56:81', 'vm-uuid': '26bec53a-de52-4a18-b778-8f917cace2dd'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: INFO os_vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:56:81,bridge_name='br-int',has_traffic_filtering=True,id=e19633a5-3e53-4b50-8b33-ec86a745a45d,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape19633a5-3e')
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:bf:eb,bridge_name='br-int',has_traffic_filtering=True,id=bd2b2398-97ca-4072-b5d8-905d2011fd16,network=Network(f1c2109f-a578-4e2a-86ae-7b6451db9280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd2b2398-97') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG os_vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:bf:eb,bridge_name='br-int',has_traffic_filtering=True,id=bd2b2398-97ca-4072-b5d8-905d2011fd16,network=Network(f1c2109f-a578-4e2a-86ae-7b6451db9280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd2b2398-97') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ce8033b-f7c3-5c66-8058-6a22c619c109', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd2b2398-97, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd2b2398-97, col_values=(('qos', UUID('e37b615f-1537-478b-8258-b05c426ba16c')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd2b2398-97, col_values=(('external_ids', {'iface-id': 'bd2b2398-97ca-4072-b5d8-905d2011fd16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:bf:eb', 'vm-uuid': '26bec53a-de52-4a18-b778-8f917cace2dd'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: INFO os_vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:bf:eb,bridge_name='br-int',has_traffic_filtering=True,id=bd2b2398-97ca-4072-b5d8-905d2011fd16,network=Network(f1c2109f-a578-4e2a-86ae-7b6451db9280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd2b2398-97')
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:09:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "address": "fa:16:3e:9b:ac:12", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3496e5b6-03", "ovs_interfaceid": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "address": "fa:16:3e:9b:ac:12", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3496e5b6-03", "ovs_interfaceid": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=3496e5b6-03c7-4c7b-9a71-932ed44c1b5e,network=Network(f1c2109f-a578-4e2a-86ae-7b6451db9280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3496e5b6-03') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG os_vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=3496e5b6-03c7-4c7b-9a71-932ed44c1b5e,network=Network(f1c2109f-a578-4e2a-86ae-7b6451db9280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3496e5b6-03') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6901c0c-44bd-5ee8-a72e-467b7e917824', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3496e5b6-03, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3496e5b6-03, col_values=(('qos', UUID('57f6dcd3-4006-49d0-a6bc-26c755cc1a7d')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3496e5b6-03, col_values=(('external_ids', {'iface-id': '3496e5b6-03c7-4c7b-9a71-932ed44c1b5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:ac:12', 'vm-uuid': '26bec53a-de52-4a18-b778-8f917cace2dd'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:52 user nova-compute[75285]: INFO os_vif [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=3496e5b6-03c7-4c7b-9a71-932ed44c1b5e,network=Network(f1c2109f-a578-4e2a-86ae-7b6451db9280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3496e5b6-03')
Nov 10 21:10:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] No BDM found with device name hda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:10:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:10:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] No VIF found with MAC fa:16:3e:ae:bb:98, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:10:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] No VIF found with MAC fa:16:3e:e9:56:81, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:10:52 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Using config drive
Nov 10 21:10:52 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Creating config drive at /opt/stack/data/nova/instances/26bec53a-de52-4a18-b778-8f917cace2dd/disk.config
Nov 10 21:10:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/26bec53a-de52-4a18-b778-8f917cace2dd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6dp73_dz {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/26bec53a-de52-4a18-b778-8f917cace2dd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6dp73_dz" returned: 0 in 0.056s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG nova.compute.manager [req-1717eaf5-c3ae-493b-83de-d4679a72546e req-037cfc84-007c-43e7-9d2d-cafc15b4c1b8 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1717eaf5-c3ae-493b-83de-d4679a72546e req-037cfc84-007c-43e7-9d2d-cafc15b4c1b8 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1717eaf5-c3ae-493b-83de-d4679a72546e req-037cfc84-007c-43e7-9d2d-cafc15b4c1b8 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1717eaf5-c3ae-493b-83de-d4679a72546e req-037cfc84-007c-43e7-9d2d-cafc15b4c1b8 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG nova.compute.manager [req-1717eaf5-c3ae-493b-83de-d4679a72546e req-037cfc84-007c-43e7-9d2d-cafc15b4c1b8 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:54 user nova-compute[75285]: WARNING nova.compute.manager [req-1717eaf5-c3ae-493b-83de-d4679a72546e req-037cfc84-007c-43e7-9d2d-cafc15b4c1b8 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-a4ec5316-300f-4095-b774-485c613db4d9 for instance with vm_state building and task_state spawning.
Nov 10 21:10:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:54 user nova-compute[75285]: INFO nova.compute.manager [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Terminating instance
Nov 10 21:10:54 user nova-compute[75285]: DEBUG nova.compute.manager [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG nova.compute.manager [req-5a4cb7e8-52e9-4dc8-a8ae-89ab0d2cc3ae req-cb30e934-1e71-4d66-bde9-f1ae6efd0886 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-fb52e593-077b-4368-93c0-aa9e1ad6717f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5a4cb7e8-52e9-4dc8-a8ae-89ab0d2cc3ae req-cb30e934-1e71-4d66-bde9-f1ae6efd0886 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5a4cb7e8-52e9-4dc8-a8ae-89ab0d2cc3ae req-cb30e934-1e71-4d66-bde9-f1ae6efd0886 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5a4cb7e8-52e9-4dc8-a8ae-89ab0d2cc3ae req-cb30e934-1e71-4d66-bde9-f1ae6efd0886 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:54 user nova-compute[75285]: DEBUG nova.compute.manager [req-5a4cb7e8-52e9-4dc8-a8ae-89ab0d2cc3ae req-cb30e934-1e71-4d66-bde9-f1ae6efd0886 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-fb52e593-077b-4368-93c0-aa9e1ad6717f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:54 user nova-compute[75285]: WARNING nova.compute.manager [req-5a4cb7e8-52e9-4dc8-a8ae-89ab0d2cc3ae req-cb30e934-1e71-4d66-bde9-f1ae6efd0886 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-fb52e593-077b-4368-93c0-aa9e1ad6717f for instance with vm_state building and task_state spawning.
Nov 10 21:10:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG nova.compute.manager [req-046fb523-ba7c-4656-a203-8bc9d7bf2159 req-cdea2019-9058-4789-8889-0046d0c6eb37 service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Received event network-vif-unplugged-3dd04dae-2f80-4478-bfe4-e97bf0389700 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-046fb523-ba7c-4656-a203-8bc9d7bf2159 req-cdea2019-9058-4789-8889-0046d0c6eb37 service nova] Acquiring lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-046fb523-ba7c-4656-a203-8bc9d7bf2159 req-cdea2019-9058-4789-8889-0046d0c6eb37 service nova] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-046fb523-ba7c-4656-a203-8bc9d7bf2159 req-cdea2019-9058-4789-8889-0046d0c6eb37 service nova] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG nova.compute.manager [req-046fb523-ba7c-4656-a203-8bc9d7bf2159 req-cdea2019-9058-4789-8889-0046d0c6eb37 service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] No waiting events found dispatching network-vif-unplugged-3dd04dae-2f80-4478-bfe4-e97bf0389700 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG nova.compute.manager [req-046fb523-ba7c-4656-a203-8bc9d7bf2159 req-cdea2019-9058-4789-8889-0046d0c6eb37 service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Received event network-vif-unplugged-3dd04dae-2f80-4478-bfe4-e97bf0389700 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:56 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Instance destroyed successfully.
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.objects.instance [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lazy-loading 'resources' on Instance uuid 20cb91b5-2a74-4f99-adf9-0db04167d2e0 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:08:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-861996084',display_name='tempest-TestVolumeBootPattern-server-861996084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-861996084',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:09:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04636b8a9e404d40a3a2bc9f63a4df8c',ramdisk_id='',reservation_id='r-007u3ntr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1962512242',owner_user_name='tempest-TestVolumeBootPattern-1962512242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:09:17Z,user_data=None,user_id='e16c471c0875416aa0eb86d89eef3a27',uuid=20cb91b5-2a74-4f99-adf9-0db04167d2e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "address": "fa:16:3e:0a:41:02", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd04dae-2f", "ovs_interfaceid": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converting VIF {"id": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "address": "fa:16:3e:0a:41:02", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd04dae-2f", "ovs_interfaceid": "3dd04dae-2f80-4478-bfe4-e97bf0389700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:41:02,bridge_name='br-int',has_traffic_filtering=True,id=3dd04dae-2f80-4478-bfe4-e97bf0389700,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd04dae-2f') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_vif [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:41:02,bridge_name='br-int',has_traffic_filtering=True,id=3dd04dae-2f80-4478-bfe4-e97bf0389700,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd04dae-2f') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dd04dae-2f, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:56 user nova-compute[75285]: WARNING nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-a4ec5316-300f-4095-b774-485c613db4d9 for instance with vm_state building and task_state spawning.
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-2d4174d5-1be7-4753-a29c-a3ed22b4af19 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-2d4174d5-1be7-4753-a29c-a3ed22b4af19 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:56 user nova-compute[75285]: WARNING nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-2d4174d5-1be7-4753-a29c-a3ed22b4af19 for instance with vm_state building and task_state spawning.
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-2d4174d5-1be7-4753-a29c-a3ed22b4af19 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-2d4174d5-1be7-4753-a29c-a3ed22b4af19 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:56 user nova-compute[75285]: WARNING nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-2d4174d5-1be7-4753-a29c-a3ed22b4af19 for instance with vm_state building and task_state spawning.
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-72df5ae8-22f3-4870-993a-19137df8e682 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-72df5ae8-22f3-4870-993a-19137df8e682 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:56 user nova-compute[75285]: WARNING nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-72df5ae8-22f3-4870-993a-19137df8e682 for instance with vm_state building and task_state spawning.
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-72df5ae8-22f3-4870-993a-19137df8e682 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-72df5ae8-22f3-4870-993a-19137df8e682 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:56 user nova-compute[75285]: WARNING nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-72df5ae8-22f3-4870-993a-19137df8e682 for instance with vm_state building and task_state spawning.
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-e19633a5-3e53-4b50-8b33-ec86a745a45d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-e19633a5-3e53-4b50-8b33-ec86a745a45d {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:56 user nova-compute[75285]: WARNING nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-e19633a5-3e53-4b50-8b33-ec86a745a45d for instance with vm_state building and task_state spawning.
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-e19633a5-3e53-4b50-8b33-ec86a745a45d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-e19633a5-3e53-4b50-8b33-ec86a745a45d {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:56 user nova-compute[75285]: WARNING nova.compute.manager [req-7c0618e7-5802-498c-a338-eef3370a6345 req-a66e236e-8972-42b5-bdac-2cc4602f2713 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-e19633a5-3e53-4b50-8b33-ec86a745a45d for instance with vm_state building and task_state spawning.
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=204f767c-3fef-490c-8a20-0422ac2fde69) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:10:56 user nova-compute[75285]: INFO os_vif [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:41:02,bridge_name='br-int',has_traffic_filtering=True,id=3dd04dae-2f80-4478-bfe4-e97bf0389700,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd04dae-2f')
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADakSLgR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:10:56 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cc961c-9857-4bb1-95c1-e5d663cef8f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:10:56 user nova-compute[75285]: No targets found.
Nov 10 21:10:56 user nova-compute[75285]: iSNS:
Nov 10 21:10:56 user nova-compute[75285]: No targets found.
Nov 10 21:10:56 user nova-compute[75285]: STATIC:
Nov 10 21:10:56 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc
Nov 10 21:10:56 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:10:56 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:10:56 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8
Nov 10 21:10:56 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:10:56 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:10:56 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906
Nov 10 21:10:56 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:10:56 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:10:56 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5
Nov 10 21:10:56 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:10:56 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:10:56 user nova-compute[75285]: FIRMWARE:
Nov 10 21:10:56 user nova-compute[75285]: No targets found.
Nov 10 21:10:56 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:10:56 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:10:56 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91550c2-e02c-4d7f-8d8d-7c9185170326]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4179e621-6411-48e5-a6a0-8065cc57adec]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:10:56 user nova-compute[75285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)
Nov 10 21:10:56 user nova-compute[75285]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)
Nov 10 21:10:56 user nova-compute[75285]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)
Nov 10 21:10:56 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 (non-flash)
Nov 10 21:10:56 user nova-compute[75285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)
Nov 10 21:10:56 user nova-compute[75285]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)
Nov 10 21:10:56 user nova-compute[75285]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)
Nov 10 21:10:56 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e4502290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906'): ({'sdc'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Removing single pathed devices sdc {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3ca1fd-3c08-42c6-acfe-7392f0bf0297]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31f08bd-e4a5-49bc-a49f-c04d12a01256]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Flushing IO for device /dev/sdc {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70f90e3-7b6b-464d-aa6b-2cc5ecab7815]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1aded5-d658-4159-a2ec-7dd82b0f8076]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1c507d-d5f4-4b51-a060-5b625d71880a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2749ce-2c48-4bb5-9c6b-cfb1cdc87c60]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906, portal: 172.16.0.220,3260]
Nov 10 21:10:56 user nova-compute[75285]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906, portal: 172.16.0.220,3260] successful.
Nov 10 21:10:56 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4eab6db-4ab1-41cb-909d-ff1162c43906 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba1b1d6-fb7a-4539-b4db-5b86447b551e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] <== disconnect_volume: return (380ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:10:56 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Deleting instance files /opt/stack/data/nova/instances/20cb91b5-2a74-4f99-adf9-0db04167d2e0_del
Nov 10 21:10:56 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Deletion of /opt/stack/data/nova/instances/20cb91b5-2a74-4f99-adf9-0db04167d2e0_del complete
Nov 10 21:10:56 user nova-compute[75285]: INFO nova.compute.manager [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Took 1.78 seconds to destroy the instance on the hypervisor.
Nov 10 21:10:56 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-fb52e593-077b-4368-93c0-aa9e1ad6717f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-fb52e593-077b-4368-93c0-aa9e1ad6717f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:57 user nova-compute[75285]: WARNING nova.compute.manager [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-fb52e593-077b-4368-93c0-aa9e1ad6717f for instance with vm_state building and task_state spawning.
Nov 10 21:10:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-bd2b2398-97ca-4072-b5d8-905d2011fd16 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-bd2b2398-97ca-4072-b5d8-905d2011fd16 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:57 user nova-compute[75285]: WARNING nova.compute.manager [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-bd2b2398-97ca-4072-b5d8-905d2011fd16 for instance with vm_state building and task_state spawning.
Nov 10 21:10:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-bd2b2398-97ca-4072-b5d8-905d2011fd16 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-bd2b2398-97ca-4072-b5d8-905d2011fd16 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:57 user nova-compute[75285]: WARNING nova.compute.manager [req-0bfee38a-a293-4a4d-8d90-3cfe53f171d2 req-6c8cb694-238f-40e4-a7ae-dd53895c5240 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-bd2b2398-97ca-4072-b5d8-905d2011fd16 for instance with vm_state building and task_state spawning.
Nov 10 21:10:57 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Received event network-vif-plugged-3dd04dae-2f80-4478-bfe4-e97bf0389700 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] Acquiring lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] No waiting events found dispatching network-vif-plugged-3dd04dae-2f80-4478-bfe4-e97bf0389700 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:57 user nova-compute[75285]: WARNING nova.compute.manager [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Received unexpected event network-vif-plugged-3dd04dae-2f80-4478-bfe4-e97bf0389700 for instance with vm_state active and task_state deleting.
Nov 10 21:10:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:57 user nova-compute[75285]: WARNING nova.compute.manager [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e for instance with vm_state building and task_state spawning.
Nov 10 21:10:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:10:57 user nova-compute[75285]: WARNING nova.compute.manager [req-0b87afb4-aeb7-4df9-af5f-10a6b052da04 req-113fa11a-d43d-438e-8308-1e2f612aa3ef service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e for instance with vm_state building and task_state spawning.
Nov 10 21:10:57 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Took 0.64 seconds to deallocate network for instance.
Nov 10 21:10:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-41048ff1-7915-4220-9f86-8296cc112170 req-d04b2b92-bc9d-4e1b-aa8a-d4b3f46c02d5 service nova] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Received event network-vif-deleted-3dd04dae-2f80-4478-bfe4-e97bf0389700 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-41048ff1-7915-4220-9f86-8296cc112170 req-d04b2b92-bc9d-4e1b-aa8a-d4b3f46c02d5 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-changed-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-41048ff1-7915-4220-9f86-8296cc112170 req-d04b2b92-bc9d-4e1b-aa8a-d4b3f46c02d5 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Refreshing instance network info cache due to event network-changed-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-41048ff1-7915-4220-9f86-8296cc112170 req-d04b2b92-bc9d-4e1b-aa8a-d4b3f46c02d5 service nova] Acquiring lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-41048ff1-7915-4220-9f86-8296cc112170 req-d04b2b92-bc9d-4e1b-aa8a-d4b3f46c02d5 service nova] Acquired lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.network.neutron [req-41048ff1-7915-4220-9f86-8296cc112170 req-d04b2b92-bc9d-4e1b-aa8a-d4b3f46c02d5 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Refreshing network info cache for port bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:10:58 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Instance spawned successfully.
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:10:58 user nova-compute[75285]: INFO nova.compute.manager [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Took 1.20 seconds to detach 1 volumes for instance.
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 20cb91b5-2a74-4f99-adf9-0db04167d2e0] Deleting volume: e4eab6db-4ab1-41cb-909d-ff1162c43906 {{(pid=75285) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:10:58 user nova-compute[75285]: INFO nova.compute.manager [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Took 11.25 seconds to spawn the instance on the hypervisor.
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:10:58 user nova-compute[75285]: INFO nova.compute.manager [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] instance snapshotting
Nov 10 21:10:58 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Beginning live snapshot process
Nov 10 21:10:58 user nova-compute[75285]: INFO nova.compute.manager [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Took 96.63 seconds to build instance.
Nov 10 21:10:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a16576d4-9e83-46ca-b5dc-e34b6d1c7e47 tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "26bec53a-de52-4a18-b778-8f917cace2dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 96.739s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.network.neutron [req-41048ff1-7915-4220-9f86-8296cc112170 req-d04b2b92-bc9d-4e1b-aa8a-d4b3f46c02d5 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updated VIF entry in instance network info cache for port bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.network.neutron [req-41048ff1-7915-4220-9f86-8296cc112170 req-d04b2b92-bc9d-4e1b-aa8a-d4b3f46c02d5 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updating instance_info_cache with network_info: [{"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-41048ff1-7915-4220-9f86-8296cc112170 req-d04b2b92-bc9d-4e1b-aa8a-d4b3f46c02d5 service nova] Releasing lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json -f qcow2 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:10:58 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:10:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json -f qcow2 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:59 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Deleted allocations for instance 20cb91b5-2a74-4f99-adf9-0db04167d2e0
Nov 10 21:10:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b70bd2e6-4aa5-402e-987e-6c2566216405 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "20cb91b5-2a74-4f99-adf9-0db04167d2e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.336s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:10:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkttrtckd/59a57c2528434c83b3e62a28fccaa1c4.delta 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:10:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkttrtckd/59a57c2528434c83b3e62a28fccaa1c4.delta 1073741824" returned: 0 in 0.057s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:10:59 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 21:11:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:11:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:11:00 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 21:11:00 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:11:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkttrtckd/59a57c2528434c83b3e62a28fccaa1c4.delta /opt/stack/data/nova/instances/snapshots/tmpkttrtckd/59a57c2528434c83b3e62a28fccaa1c4 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkttrtckd/59a57c2528434c83b3e62a28fccaa1c4.delta /opt/stack/data/nova/instances/snapshots/tmpkttrtckd/59a57c2528434c83b3e62a28fccaa1c4" returned: 0 in 0.461s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:01 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Snapshot extracted, beginning image upload
Nov 10 21:11:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:04 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Snapshot image upload complete
Nov 10 21:11:04 user nova-compute[75285]: INFO nova.compute.manager [None req-31470893-c426-4c86-9642-9caa3efdad84 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Took 5.74 seconds to snapshot the instance on the hypervisor.
Nov 10 21:11:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:28 user nova-compute[75285]: DEBUG nova.compute.manager [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:11:29 user nova-compute[75285]: INFO nova.compute.claims [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Claim successful on node user
Nov 10 21:11:29 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG nova.network.neutron [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:11:29 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:11:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG nova.policy [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9c20460877a428e9fa97869ba34eb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44979c0f5b7d4205a0e5e0becbe714cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:11:29 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Creating image(s)
Nov 10 21:11:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "/opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "/opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.192s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk 1073741824" returned: 0 in 0.053s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Cannot resize image /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Ensure instance console log exists: /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:31 user nova-compute[75285]: DEBUG nova.network.neutron [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Successfully created port: ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:11:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:32 user nova-compute[75285]: DEBUG nova.network.neutron [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Successfully updated port: ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:11:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:11:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquired lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:11:32 user nova-compute[75285]: DEBUG nova.network.neutron [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:11:32 user nova-compute[75285]: DEBUG nova.compute.manager [req-96072e39-4439-40ef-a608-c6267b4d7736 req-faa7a600-daac-4504-bf56-f7dc0942f27e service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-changed-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:11:32 user nova-compute[75285]: DEBUG nova.compute.manager [req-96072e39-4439-40ef-a608-c6267b4d7736 req-faa7a600-daac-4504-bf56-f7dc0942f27e service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Refreshing instance network info cache due to event network-changed-ea61ffb9-f415-4c97-850b-56d25719be25. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:11:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-96072e39-4439-40ef-a608-c6267b4d7736 req-faa7a600-daac-4504-bf56-f7dc0942f27e service nova] Acquiring lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:11:32 user nova-compute[75285]: DEBUG nova.network.neutron [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.network.neutron [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Updating instance_info_cache with network_info: [{"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Releasing lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.compute.manager [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Instance network_info: |[{"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-96072e39-4439-40ef-a608-c6267b4d7736 req-faa7a600-daac-4504-bf56-f7dc0942f27e service nova] Acquired lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.network.neutron [req-96072e39-4439-40ef-a608-c6267b4d7736 req-faa7a600-daac-4504-bf56-f7dc0942f27e service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Refreshing network info cache for port ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Start _get_guest_xml network_info=[{"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:11:33 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:11:33 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-296914162',display_name='tempest-ServerRescueNegativeTestJSON-server-296914162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-296914162',id=18,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZO1bKLdjQN9DGspd4XutMTTKdyiBAMV6FMPoy2h7xkksoFYNkPa1t1BqodYNZWKqcnnIbgjknrj76HYMDIeWcvHN/RKtVyptYqOXFGz/EWmZDGBaxg8oPRKR0yssggfA==',key_name='tempest-keypair-822010462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44979c0f5b7d4205a0e5e0becbe714cb',ramdisk_id='',reservation_id='r-oeqrgq9r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-418662944',owner_user_name='tempest-ServerRescueNegativeTestJSON-418662944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9c20460877a428e9fa97869ba34eb04',uuid=0ad7b009-e56f-48ae-8643-29abadf283a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converting VIF {"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3e:8b,bridge_name='br-int',has_traffic_filtering=True,id=ea61ffb9-f415-4c97-850b-56d25719be25,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea61ffb9-f4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.objects.instance [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ad7b009-e56f-48ae-8643-29abadf283a4 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:11:33 user nova-compute[75285]:   <uuid>0ad7b009-e56f-48ae-8643-29abadf283a4</uuid>
Nov 10 21:11:33 user nova-compute[75285]:   <name>instance-00000012</name>
Nov 10 21:11:33 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:11:33 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:11:33 user nova-compute[75285]:   <metadata>
Nov 10 21:11:33 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:11:33 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:11:33 user nova-compute[75285]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-296914162</nova:name>
Nov 10 21:11:33 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:11:33</nova:creationTime>
Nov 10 21:11:33 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:11:33 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:11:33 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:11:33 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:11:33 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:11:33 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:11:33 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:11:33 user nova-compute[75285]:       <nova:owner>
Nov 10 21:11:33 user nova-compute[75285]:         <nova:user uuid="b9c20460877a428e9fa97869ba34eb04">tempest-ServerRescueNegativeTestJSON-418662944-project-member</nova:user>
Nov 10 21:11:33 user nova-compute[75285]:         <nova:project uuid="44979c0f5b7d4205a0e5e0becbe714cb">tempest-ServerRescueNegativeTestJSON-418662944</nova:project>
Nov 10 21:11:33 user nova-compute[75285]:       </nova:owner>
Nov 10 21:11:33 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:11:33 user nova-compute[75285]:       <nova:ports>
Nov 10 21:11:33 user nova-compute[75285]:         <nova:port uuid="ea61ffb9-f415-4c97-850b-56d25719be25">
Nov 10 21:11:33 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 21:11:33 user nova-compute[75285]:         </nova:port>
Nov 10 21:11:33 user nova-compute[75285]:       </nova:ports>
Nov 10 21:11:33 user nova-compute[75285]:     </nova:instance>
Nov 10 21:11:33 user nova-compute[75285]:   </metadata>
Nov 10 21:11:33 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:11:33 user nova-compute[75285]:     <system>
Nov 10 21:11:33 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:11:33 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:11:33 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:11:33 user nova-compute[75285]:       <entry name="serial">0ad7b009-e56f-48ae-8643-29abadf283a4</entry>
Nov 10 21:11:33 user nova-compute[75285]:       <entry name="uuid">0ad7b009-e56f-48ae-8643-29abadf283a4</entry>
Nov 10 21:11:33 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:11:33 user nova-compute[75285]:     </system>
Nov 10 21:11:33 user nova-compute[75285]:   </sysinfo>
Nov 10 21:11:33 user nova-compute[75285]:   <os>
Nov 10 21:11:33 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:11:33 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:11:33 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:11:33 user nova-compute[75285]:   </os>
Nov 10 21:11:33 user nova-compute[75285]:   <features>
Nov 10 21:11:33 user nova-compute[75285]:     <acpi/>
Nov 10 21:11:33 user nova-compute[75285]:     <apic/>
Nov 10 21:11:33 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:11:33 user nova-compute[75285]:   </features>
Nov 10 21:11:33 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:11:33 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:11:33 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:11:33 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:11:33 user nova-compute[75285]:   </clock>
Nov 10 21:11:33 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:11:33 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:11:33 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:11:33 user nova-compute[75285]:   </cpu>
Nov 10 21:11:33 user nova-compute[75285]:   <devices>
Nov 10 21:11:33 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:11:33 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:11:33 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk"/>
Nov 10 21:11:33 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:11:33 user nova-compute[75285]:     </disk>
Nov 10 21:11:33 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:11:33 user nova-compute[75285]:       <mac address="fa:16:3e:1c:3e:8b"/>
Nov 10 21:11:33 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:11:33 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:11:33 user nova-compute[75285]:       <target dev="tapea61ffb9-f4"/>
Nov 10 21:11:33 user nova-compute[75285]:     </interface>
Nov 10 21:11:33 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:11:33 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/console.log" append="off"/>
Nov 10 21:11:33 user nova-compute[75285]:     </serial>
Nov 10 21:11:33 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:11:33 user nova-compute[75285]:     <video>
Nov 10 21:11:33 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:11:33 user nova-compute[75285]:     </video>
Nov 10 21:11:33 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:11:33 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:11:33 user nova-compute[75285]:     </rng>
Nov 10 21:11:33 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:11:33 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:11:33 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:11:33 user nova-compute[75285]:     </memballoon>
Nov 10 21:11:33 user nova-compute[75285]:   </devices>
Nov 10 21:11:33 user nova-compute[75285]: </domain>
Nov 10 21:11:33 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-296914162',display_name='tempest-ServerRescueNegativeTestJSON-server-296914162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-296914162',id=18,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZO1bKLdjQN9DGspd4XutMTTKdyiBAMV6FMPoy2h7xkksoFYNkPa1t1BqodYNZWKqcnnIbgjknrj76HYMDIeWcvHN/RKtVyptYqOXFGz/EWmZDGBaxg8oPRKR0yssggfA==',key_name='tempest-keypair-822010462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44979c0f5b7d4205a0e5e0becbe714cb',ramdisk_id='',reservation_id='r-oeqrgq9r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-418662944',owner_user_name='tempest-ServerRescueNegativeTestJSON-418662944-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9c20460877a428e9fa97869ba34eb04',uuid=0ad7b009-e56f-48ae-8643-29abadf283a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converting VIF {"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3e:8b,bridge_name='br-int',has_traffic_filtering=True,id=ea61ffb9-f415-4c97-850b-56d25719be25,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea61ffb9-f4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG os_vif [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3e:8b,bridge_name='br-int',has_traffic_filtering=True,id=ea61ffb9-f415-4c97-850b-56d25719be25,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea61ffb9-f4') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e642d0dc-676d-5dd2-b705-2913b3a7df28', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea61ffb9-f4, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea61ffb9-f4, col_values=(('qos', UUID('01e3d81f-7e6a-4b9a-83fc-9d60d297d798')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea61ffb9-f4, col_values=(('external_ids', {'iface-id': 'ea61ffb9-f415-4c97-850b-56d25719be25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:3e:8b', 'vm-uuid': '0ad7b009-e56f-48ae-8643-29abadf283a4'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:33 user nova-compute[75285]: INFO os_vif [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:3e:8b,bridge_name='br-int',has_traffic_filtering=True,id=ea61ffb9-f415-4c97-850b-56d25719be25,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea61ffb9-f4')
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:11:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No VIF found with MAC fa:16:3e:1c:3e:8b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:11:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-96072e39-4439-40ef-a608-c6267b4d7736 req-faa7a600-daac-4504-bf56-f7dc0942f27e service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Updated VIF entry in instance network info cache for port ea61ffb9-f415-4c97-850b-56d25719be25. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:11:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-96072e39-4439-40ef-a608-c6267b4d7736 req-faa7a600-daac-4504-bf56-f7dc0942f27e service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Updating instance_info_cache with network_info: [{"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:11:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-96072e39-4439-40ef-a608-c6267b4d7736 req-faa7a600-daac-4504-bf56-f7dc0942f27e service nova] Releasing lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:11:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:35 user nova-compute[75285]: DEBUG nova.compute.manager [req-d643bc58-a91d-49a2-8194-7b45477201ec req-d8dafd5a-2cb2-4b44-b446-6ba27ef420ae service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:11:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d643bc58-a91d-49a2-8194-7b45477201ec req-d8dafd5a-2cb2-4b44-b446-6ba27ef420ae service nova] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d643bc58-a91d-49a2-8194-7b45477201ec req-d8dafd5a-2cb2-4b44-b446-6ba27ef420ae service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d643bc58-a91d-49a2-8194-7b45477201ec req-d8dafd5a-2cb2-4b44-b446-6ba27ef420ae service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:35 user nova-compute[75285]: DEBUG nova.compute.manager [req-d643bc58-a91d-49a2-8194-7b45477201ec req-d8dafd5a-2cb2-4b44-b446-6ba27ef420ae service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] No waiting events found dispatching network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:11:35 user nova-compute[75285]: WARNING nova.compute.manager [req-d643bc58-a91d-49a2-8194-7b45477201ec req-d8dafd5a-2cb2-4b44-b446-6ba27ef420ae service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received unexpected event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 for instance with vm_state building and task_state spawning.
Nov 10 21:11:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:35 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:11:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquiring lock "72a39007-63f0-4f1b-8689-286c55ea1d0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:36 user nova-compute[75285]: DEBUG nova.compute.manager [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:11:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:36 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:11:36 user nova-compute[75285]: INFO nova.compute.claims [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Claim successful on node user
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:11:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Instance spawned successfully.
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:11:37 user nova-compute[75285]: INFO nova.compute.manager [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Took 7.44 seconds to spawn the instance on the hypervisor.
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-8286f683-a461-4d7c-9acb-36402d19ebe2 req-4d976fe5-0479-4837-b5ae-8bed902df228 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8286f683-a461-4d7c-9acb-36402d19ebe2 req-4d976fe5-0479-4837-b5ae-8bed902df228 service nova] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8286f683-a461-4d7c-9acb-36402d19ebe2 req-4d976fe5-0479-4837-b5ae-8bed902df228 service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8286f683-a461-4d7c-9acb-36402d19ebe2 req-4d976fe5-0479-4837-b5ae-8bed902df228 service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-8286f683-a461-4d7c-9acb-36402d19ebe2 req-4d976fe5-0479-4837-b5ae-8bed902df228 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] No waiting events found dispatching network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:11:37 user nova-compute[75285]: WARNING nova.compute.manager [req-8286f683-a461-4d7c-9acb-36402d19ebe2 req-4d976fe5-0479-4837-b5ae-8bed902df228 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received unexpected event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 for instance with vm_state building and task_state spawning.
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.network.neutron [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:11:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:11:37 user nova-compute[75285]: INFO nova.compute.manager [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Took 8.21 seconds to build instance.
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-327967c8-96d7-4850-b6a2-5ed27dec50f1 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.335s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.policy [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '981d0b2799324071ae1a6a3913771284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc24a39d61f54c2791450912c1be7979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:11:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Creating image(s)
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquiring lock "/opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "/opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "/opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.208s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk 1073741824" returned: 0 in 0.050s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:38 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:11:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:38 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Cannot resize image /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:11:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:11:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Ensure instance console log exists: /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:11:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:38 user nova-compute[75285]: DEBUG nova.network.neutron [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Successfully created port: 365cab06-6f34-462e-95e8-e2a687de3a45 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:11:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:38 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.network.neutron [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Successfully updated port: 365cab06-6f34-462e-95e8-e2a687de3a45 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquiring lock "refresh_cache-72a39007-63f0-4f1b-8689-286c55ea1d0c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquired lock "refresh_cache-72a39007-63f0-4f1b-8689-286c55ea1d0c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.network.neutron [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-64b2169b-bc93-4b32-9123-b4ed03cb9168 req-0d658433-4d65-4b37-8f59-4670f945e9e7 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Received event network-changed-365cab06-6f34-462e-95e8-e2a687de3a45 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-64b2169b-bc93-4b32-9123-b4ed03cb9168 req-0d658433-4d65-4b37-8f59-4670f945e9e7 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Refreshing instance network info cache due to event network-changed-365cab06-6f34-462e-95e8-e2a687de3a45. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-64b2169b-bc93-4b32-9123-b4ed03cb9168 req-0d658433-4d65-4b37-8f59-4670f945e9e7 service nova] Acquiring lock "refresh_cache-72a39007-63f0-4f1b-8689-286c55ea1d0c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.network.neutron [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.network.neutron [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Updating instance_info_cache with network_info: [{"id": "365cab06-6f34-462e-95e8-e2a687de3a45", "address": "fa:16:3e:6d:b9:79", "network": {"id": "c0b03adc-d01b-42c3-9244-04fe32e5710a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646536397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc24a39d61f54c2791450912c1be7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365cab06-6f", "ovs_interfaceid": "365cab06-6f34-462e-95e8-e2a687de3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Releasing lock "refresh_cache-72a39007-63f0-4f1b-8689-286c55ea1d0c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Instance network_info: |[{"id": "365cab06-6f34-462e-95e8-e2a687de3a45", "address": "fa:16:3e:6d:b9:79", "network": {"id": "c0b03adc-d01b-42c3-9244-04fe32e5710a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646536397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc24a39d61f54c2791450912c1be7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365cab06-6f", "ovs_interfaceid": "365cab06-6f34-462e-95e8-e2a687de3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-64b2169b-bc93-4b32-9123-b4ed03cb9168 req-0d658433-4d65-4b37-8f59-4670f945e9e7 service nova] Acquired lock "refresh_cache-72a39007-63f0-4f1b-8689-286c55ea1d0c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.network.neutron [req-64b2169b-bc93-4b32-9123-b4ed03cb9168 req-0d658433-4d65-4b37-8f59-4670f945e9e7 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Refreshing network info cache for port 365cab06-6f34-462e-95e8-e2a687de3a45 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Start _get_guest_xml network_info=[{"id": "365cab06-6f34-462e-95e8-e2a687de3a45", "address": "fa:16:3e:6d:b9:79", "network": {"id": "c0b03adc-d01b-42c3-9244-04fe32e5710a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646536397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc24a39d61f54c2791450912c1be7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365cab06-6f", "ovs_interfaceid": "365cab06-6f34-462e-95e8-e2a687de3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:11:39 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:11:39 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2014523589',display_name='tempest-DeleteServersTestJSON-server-2014523589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2014523589',id=19,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc24a39d61f54c2791450912c1be7979',ramdisk_id='',reservation_id='r-q06zdm3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2100112621',owner_user_name='tempest-DeleteServersTestJSON-2100112621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:11:37Z,user_data=None,user_id='981d0b2799324071ae1a6a3913771284',uuid=72a39007-63f0-4f1b-8689-286c55ea1d0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "365cab06-6f34-462e-95e8-e2a687de3a45", "address": "fa:16:3e:6d:b9:79", "network": {"id": "c0b03adc-d01b-42c3-9244-04fe32e5710a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646536397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc24a39d61f54c2791450912c1be7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365cab06-6f", "ovs_interfaceid": "365cab06-6f34-462e-95e8-e2a687de3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Converting VIF {"id": "365cab06-6f34-462e-95e8-e2a687de3a45", "address": "fa:16:3e:6d:b9:79", "network": {"id": "c0b03adc-d01b-42c3-9244-04fe32e5710a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646536397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc24a39d61f54c2791450912c1be7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365cab06-6f", "ovs_interfaceid": "365cab06-6f34-462e-95e8-e2a687de3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b9:79,bridge_name='br-int',has_traffic_filtering=True,id=365cab06-6f34-462e-95e8-e2a687de3a45,network=Network(c0b03adc-d01b-42c3-9244-04fe32e5710a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365cab06-6f') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.objects.instance [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lazy-loading 'pci_devices' on Instance uuid 72a39007-63f0-4f1b-8689-286c55ea1d0c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:11:39 user nova-compute[75285]:   <uuid>72a39007-63f0-4f1b-8689-286c55ea1d0c</uuid>
Nov 10 21:11:39 user nova-compute[75285]:   <name>instance-00000013</name>
Nov 10 21:11:39 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:11:39 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:11:39 user nova-compute[75285]:   <metadata>
Nov 10 21:11:39 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:11:39 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:11:39 user nova-compute[75285]:       <nova:name>tempest-DeleteServersTestJSON-server-2014523589</nova:name>
Nov 10 21:11:39 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:11:39</nova:creationTime>
Nov 10 21:11:39 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:11:39 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:11:39 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:11:39 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:11:39 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:11:39 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:11:39 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:11:39 user nova-compute[75285]:       <nova:owner>
Nov 10 21:11:39 user nova-compute[75285]:         <nova:user uuid="981d0b2799324071ae1a6a3913771284">tempest-DeleteServersTestJSON-2100112621-project-member</nova:user>
Nov 10 21:11:39 user nova-compute[75285]:         <nova:project uuid="bc24a39d61f54c2791450912c1be7979">tempest-DeleteServersTestJSON-2100112621</nova:project>
Nov 10 21:11:39 user nova-compute[75285]:       </nova:owner>
Nov 10 21:11:39 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:11:39 user nova-compute[75285]:       <nova:ports>
Nov 10 21:11:39 user nova-compute[75285]:         <nova:port uuid="365cab06-6f34-462e-95e8-e2a687de3a45">
Nov 10 21:11:39 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 21:11:39 user nova-compute[75285]:         </nova:port>
Nov 10 21:11:39 user nova-compute[75285]:       </nova:ports>
Nov 10 21:11:39 user nova-compute[75285]:     </nova:instance>
Nov 10 21:11:39 user nova-compute[75285]:   </metadata>
Nov 10 21:11:39 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:11:39 user nova-compute[75285]:     <system>
Nov 10 21:11:39 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:11:39 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:11:39 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:11:39 user nova-compute[75285]:       <entry name="serial">72a39007-63f0-4f1b-8689-286c55ea1d0c</entry>
Nov 10 21:11:39 user nova-compute[75285]:       <entry name="uuid">72a39007-63f0-4f1b-8689-286c55ea1d0c</entry>
Nov 10 21:11:39 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:11:39 user nova-compute[75285]:     </system>
Nov 10 21:11:39 user nova-compute[75285]:   </sysinfo>
Nov 10 21:11:39 user nova-compute[75285]:   <os>
Nov 10 21:11:39 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:11:39 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:11:39 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:11:39 user nova-compute[75285]:   </os>
Nov 10 21:11:39 user nova-compute[75285]:   <features>
Nov 10 21:11:39 user nova-compute[75285]:     <acpi/>
Nov 10 21:11:39 user nova-compute[75285]:     <apic/>
Nov 10 21:11:39 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:11:39 user nova-compute[75285]:   </features>
Nov 10 21:11:39 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:11:39 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:11:39 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:11:39 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:11:39 user nova-compute[75285]:   </clock>
Nov 10 21:11:39 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:11:39 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:11:39 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:11:39 user nova-compute[75285]:   </cpu>
Nov 10 21:11:39 user nova-compute[75285]:   <devices>
Nov 10 21:11:39 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:11:39 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:11:39 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk"/>
Nov 10 21:11:39 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:11:39 user nova-compute[75285]:     </disk>
Nov 10 21:11:39 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:11:39 user nova-compute[75285]:       <mac address="fa:16:3e:6d:b9:79"/>
Nov 10 21:11:39 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:11:39 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:11:39 user nova-compute[75285]:       <target dev="tap365cab06-6f"/>
Nov 10 21:11:39 user nova-compute[75285]:     </interface>
Nov 10 21:11:39 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:11:39 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/console.log" append="off"/>
Nov 10 21:11:39 user nova-compute[75285]:     </serial>
Nov 10 21:11:39 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:11:39 user nova-compute[75285]:     <video>
Nov 10 21:11:39 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:11:39 user nova-compute[75285]:     </video>
Nov 10 21:11:39 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:11:39 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:11:39 user nova-compute[75285]:     </rng>
Nov 10 21:11:39 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:11:39 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:11:39 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:11:39 user nova-compute[75285]:     </memballoon>
Nov 10 21:11:39 user nova-compute[75285]:   </devices>
Nov 10 21:11:39 user nova-compute[75285]: </domain>
Nov 10 21:11:39 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2014523589',display_name='tempest-DeleteServersTestJSON-server-2014523589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2014523589',id=19,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc24a39d61f54c2791450912c1be7979',ramdisk_id='',reservation_id='r-q06zdm3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2100112621',owner_user_name='tempest-DeleteServersTestJSON-2100112621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:11:37Z,user_data=None,user_id='981d0b2799324071ae1a6a3913771284',uuid=72a39007-63f0-4f1b-8689-286c55ea1d0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "365cab06-6f34-462e-95e8-e2a687de3a45", "address": "fa:16:3e:6d:b9:79", "network": {"id": "c0b03adc-d01b-42c3-9244-04fe32e5710a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646536397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc24a39d61f54c2791450912c1be7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365cab06-6f", "ovs_interfaceid": "365cab06-6f34-462e-95e8-e2a687de3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Converting VIF {"id": "365cab06-6f34-462e-95e8-e2a687de3a45", "address": "fa:16:3e:6d:b9:79", "network": {"id": "c0b03adc-d01b-42c3-9244-04fe32e5710a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646536397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc24a39d61f54c2791450912c1be7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365cab06-6f", "ovs_interfaceid": "365cab06-6f34-462e-95e8-e2a687de3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b9:79,bridge_name='br-int',has_traffic_filtering=True,id=365cab06-6f34-462e-95e8-e2a687de3a45,network=Network(c0b03adc-d01b-42c3-9244-04fe32e5710a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365cab06-6f') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG os_vif [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b9:79,bridge_name='br-int',has_traffic_filtering=True,id=365cab06-6f34-462e-95e8-e2a687de3a45,network=Network(c0b03adc-d01b-42c3-9244-04fe32e5710a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365cab06-6f') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3d0d256-c313-557a-a8cb-988e8553efb2', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap365cab06-6f, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap365cab06-6f, col_values=(('qos', UUID('9d832cb8-8275-44a8-96de-29ed30ae6cd7')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap365cab06-6f, col_values=(('external_ids', {'iface-id': '365cab06-6f34-462e-95e8-e2a687de3a45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:b9:79', 'vm-uuid': '72a39007-63f0-4f1b-8689-286c55ea1d0c'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:39 user nova-compute[75285]: INFO os_vif [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b9:79,bridge_name='br-int',has_traffic_filtering=True,id=365cab06-6f34-462e-95e8-e2a687de3a45,network=Network(c0b03adc-d01b-42c3-9244-04fe32e5710a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365cab06-6f')
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:11:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] No VIF found with MAC fa:16:3e:6d:b9:79, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:11:40 user nova-compute[75285]: DEBUG nova.network.neutron [req-64b2169b-bc93-4b32-9123-b4ed03cb9168 req-0d658433-4d65-4b37-8f59-4670f945e9e7 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Updated VIF entry in instance network info cache for port 365cab06-6f34-462e-95e8-e2a687de3a45. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:11:40 user nova-compute[75285]: DEBUG nova.network.neutron [req-64b2169b-bc93-4b32-9123-b4ed03cb9168 req-0d658433-4d65-4b37-8f59-4670f945e9e7 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Updating instance_info_cache with network_info: [{"id": "365cab06-6f34-462e-95e8-e2a687de3a45", "address": "fa:16:3e:6d:b9:79", "network": {"id": "c0b03adc-d01b-42c3-9244-04fe32e5710a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646536397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc24a39d61f54c2791450912c1be7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365cab06-6f", "ovs_interfaceid": "365cab06-6f34-462e-95e8-e2a687de3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:11:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-64b2169b-bc93-4b32-9123-b4ed03cb9168 req-0d658433-4d65-4b37-8f59-4670f945e9e7 service nova] Releasing lock "refresh_cache-72a39007-63f0-4f1b-8689-286c55ea1d0c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:11:40 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:11:40 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:11:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:11:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:11:40 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Updating instance_info_cache with network_info: [{"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-bab1bc9f-0f45-4a1e-a592-f895d5d70fab req-225793b7-834d-48c1-a0db-1bbeeb834711 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Received event network-vif-plugged-365cab06-6f34-462e-95e8-e2a687de3a45 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bab1bc9f-0f45-4a1e-a592-f895d5d70fab req-225793b7-834d-48c1-a0db-1bbeeb834711 service nova] Acquiring lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bab1bc9f-0f45-4a1e-a592-f895d5d70fab req-225793b7-834d-48c1-a0db-1bbeeb834711 service nova] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bab1bc9f-0f45-4a1e-a592-f895d5d70fab req-225793b7-834d-48c1-a0db-1bbeeb834711 service nova] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-bab1bc9f-0f45-4a1e-a592-f895d5d70fab req-225793b7-834d-48c1-a0db-1bbeeb834711 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] No waiting events found dispatching network-vif-plugged-365cab06-6f34-462e-95e8-e2a687de3a45 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:11:41 user nova-compute[75285]: WARNING nova.compute.manager [req-bab1bc9f-0f45-4a1e-a592-f895d5d70fab req-225793b7-834d-48c1-a0db-1bbeeb834711 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Received unexpected event network-vif-plugged-365cab06-6f34-462e-95e8-e2a687de3a45 for instance with vm_state building and task_state spawning.
Nov 10 21:11:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:11:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:11:43 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Instance spawned successfully.
Nov 10 21:11:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:11:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:44 user nova-compute[75285]: DEBUG nova.compute.manager [req-15a9d474-166e-48a6-85d2-0ded709e0140 req-ca2f7e09-f439-424a-a8c9-7cd75f9347a8 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Received event network-vif-plugged-365cab06-6f34-462e-95e8-e2a687de3a45 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:11:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-15a9d474-166e-48a6-85d2-0ded709e0140 req-ca2f7e09-f439-424a-a8c9-7cd75f9347a8 service nova] Acquiring lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-15a9d474-166e-48a6-85d2-0ded709e0140 req-ca2f7e09-f439-424a-a8c9-7cd75f9347a8 service nova] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-15a9d474-166e-48a6-85d2-0ded709e0140 req-ca2f7e09-f439-424a-a8c9-7cd75f9347a8 service nova] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:44 user nova-compute[75285]: DEBUG nova.compute.manager [req-15a9d474-166e-48a6-85d2-0ded709e0140 req-ca2f7e09-f439-424a-a8c9-7cd75f9347a8 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] No waiting events found dispatching network-vif-plugged-365cab06-6f34-462e-95e8-e2a687de3a45 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:11:44 user nova-compute[75285]: WARNING nova.compute.manager [req-15a9d474-166e-48a6-85d2-0ded709e0140 req-ca2f7e09-f439-424a-a8c9-7cd75f9347a8 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Received unexpected event network-vif-plugged-365cab06-6f34-462e-95e8-e2a687de3a45 for instance with vm_state building and task_state spawning.
Nov 10 21:11:44 user nova-compute[75285]: INFO nova.compute.manager [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 10 21:11:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:11:44 user nova-compute[75285]: INFO nova.compute.manager [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Took 7.57 seconds to build instance.
Nov 10 21:11:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-82c6374c-6e3a-486f-b9cb-cc8eb4e8b3e4 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.741s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:11:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:11:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:11:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:48 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:11:48 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:11:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7899MB free_disk=25.35843276977539GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 09ab2e54-1189-420e-9e5c-d158e4106ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 26bec53a-de52-4a18-b778-8f917cace2dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3a0c67ef-1414-47e0-8769-c9164baf8993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 0ad7b009-e56f-48ae-8643-29abadf283a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 72a39007-63f0-4f1b-8689-286c55ea1d0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:11:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:49 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:11:49 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:11:49 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:11:49 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:11:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "073785c4-a92c-4297-ab62-55c31b424ffc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:11:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:50 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:11:50 user nova-compute[75285]: INFO nova.compute.claims [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Claim successful on node user
Nov 10 21:11:50 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:11:50 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:11:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:11:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:11:50 user nova-compute[75285]: DEBUG nova.network.neutron [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:11:50 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:11:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:11:50 user nova-compute[75285]: DEBUG nova.policy [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51709428ae324620840611f8eb1c216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846fec1848ac4cbfa88b60ba0cf98e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG nova.compute.manager [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:11:51 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Creating image(s)
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "/opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "/opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "/opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.200s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk 1073741824" returned: 0 in 0.062s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.254s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG nova.network.neutron [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Successfully created port: e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Cannot resize image /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Ensure instance console log exists: /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.network.neutron [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Successfully updated port: e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquired lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.network.neutron [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.compute.manager [req-58e612b6-bf40-49a1-ba20-e613f8484192 req-dbc5a475-6cc1-40de-843c-ba7327a9a0eb service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received event network-changed-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.compute.manager [req-58e612b6-bf40-49a1-ba20-e613f8484192 req-dbc5a475-6cc1-40de-843c-ba7327a9a0eb service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Refreshing instance network info cache due to event network-changed-e23cea65-b47d-4daf-8640-b3617916099e. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-58e612b6-bf40-49a1-ba20-e613f8484192 req-dbc5a475-6cc1-40de-843c-ba7327a9a0eb service nova] Acquiring lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.network.neutron [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.network.neutron [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Updating instance_info_cache with network_info: [{"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Releasing lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.compute.manager [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Instance network_info: |[{"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-58e612b6-bf40-49a1-ba20-e613f8484192 req-dbc5a475-6cc1-40de-843c-ba7327a9a0eb service nova] Acquired lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.network.neutron [req-58e612b6-bf40-49a1-ba20-e613f8484192 req-dbc5a475-6cc1-40de-843c-ba7327a9a0eb service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Refreshing network info cache for port e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Start _get_guest_xml network_info=[{"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:11:52 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:11:52 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:11:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-252199540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-252199540',id=20,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrGHdrWmXZnDobcBkLbJDGNOuNulhOQtjTZ0Td0zuu4Ik7AfZ4rcF63yRHtlxB6ukOXyIp7pnw4VEbd9lzTdIAPD9ZB8MrI5zYYtAh7DVkigItt1bjyVEFS0OXB4+k5sQ==',key_name='tempest-keypair-1489604129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846fec1848ac4cbfa88b60ba0cf98e3c',ramdisk_id='',reservation_id='r-fi8ja34n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-605808320',owner_user_name='tempest-AttachVolumeShelveTestJSON-605808320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:11:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51709428ae324620840611f8eb1c216f',uuid=073785c4-a92c-4297-ab62-55c31b424ffc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converting VIF {"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=e23cea65-b47d-4daf-8640-b3617916099e,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape23cea65-b4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:11:52 user nova-compute[75285]: DEBUG nova.objects.instance [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'pci_devices' on Instance uuid 073785c4-a92c-4297-ab62-55c31b424ffc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:11:53 user nova-compute[75285]:   <uuid>073785c4-a92c-4297-ab62-55c31b424ffc</uuid>
Nov 10 21:11:53 user nova-compute[75285]:   <name>instance-00000014</name>
Nov 10 21:11:53 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:11:53 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:11:53 user nova-compute[75285]:   <metadata>
Nov 10 21:11:53 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:11:53 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:11:53 user nova-compute[75285]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-252199540</nova:name>
Nov 10 21:11:53 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:11:52</nova:creationTime>
Nov 10 21:11:53 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:11:53 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:11:53 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:11:53 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:11:53 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:11:53 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:11:53 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:11:53 user nova-compute[75285]:       <nova:owner>
Nov 10 21:11:53 user nova-compute[75285]:         <nova:user uuid="51709428ae324620840611f8eb1c216f">tempest-AttachVolumeShelveTestJSON-605808320-project-member</nova:user>
Nov 10 21:11:53 user nova-compute[75285]:         <nova:project uuid="846fec1848ac4cbfa88b60ba0cf98e3c">tempest-AttachVolumeShelveTestJSON-605808320</nova:project>
Nov 10 21:11:53 user nova-compute[75285]:       </nova:owner>
Nov 10 21:11:53 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:11:53 user nova-compute[75285]:       <nova:ports>
Nov 10 21:11:53 user nova-compute[75285]:         <nova:port uuid="e23cea65-b47d-4daf-8640-b3617916099e">
Nov 10 21:11:53 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 21:11:53 user nova-compute[75285]:         </nova:port>
Nov 10 21:11:53 user nova-compute[75285]:       </nova:ports>
Nov 10 21:11:53 user nova-compute[75285]:     </nova:instance>
Nov 10 21:11:53 user nova-compute[75285]:   </metadata>
Nov 10 21:11:53 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:11:53 user nova-compute[75285]:     <system>
Nov 10 21:11:53 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:11:53 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:11:53 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:11:53 user nova-compute[75285]:       <entry name="serial">073785c4-a92c-4297-ab62-55c31b424ffc</entry>
Nov 10 21:11:53 user nova-compute[75285]:       <entry name="uuid">073785c4-a92c-4297-ab62-55c31b424ffc</entry>
Nov 10 21:11:53 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:11:53 user nova-compute[75285]:     </system>
Nov 10 21:11:53 user nova-compute[75285]:   </sysinfo>
Nov 10 21:11:53 user nova-compute[75285]:   <os>
Nov 10 21:11:53 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:11:53 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:11:53 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:11:53 user nova-compute[75285]:   </os>
Nov 10 21:11:53 user nova-compute[75285]:   <features>
Nov 10 21:11:53 user nova-compute[75285]:     <acpi/>
Nov 10 21:11:53 user nova-compute[75285]:     <apic/>
Nov 10 21:11:53 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:11:53 user nova-compute[75285]:   </features>
Nov 10 21:11:53 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:11:53 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:11:53 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:11:53 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:11:53 user nova-compute[75285]:   </clock>
Nov 10 21:11:53 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:11:53 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:11:53 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:11:53 user nova-compute[75285]:   </cpu>
Nov 10 21:11:53 user nova-compute[75285]:   <devices>
Nov 10 21:11:53 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:11:53 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:11:53 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk"/>
Nov 10 21:11:53 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:11:53 user nova-compute[75285]:     </disk>
Nov 10 21:11:53 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:11:53 user nova-compute[75285]:       <mac address="fa:16:3e:5b:1e:9d"/>
Nov 10 21:11:53 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:11:53 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:11:53 user nova-compute[75285]:       <target dev="tape23cea65-b4"/>
Nov 10 21:11:53 user nova-compute[75285]:     </interface>
Nov 10 21:11:53 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:11:53 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/console.log" append="off"/>
Nov 10 21:11:53 user nova-compute[75285]:     </serial>
Nov 10 21:11:53 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:11:53 user nova-compute[75285]:     <video>
Nov 10 21:11:53 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:11:53 user nova-compute[75285]:     </video>
Nov 10 21:11:53 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:11:53 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:11:53 user nova-compute[75285]:     </rng>
Nov 10 21:11:53 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:11:53 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:11:53 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:11:53 user nova-compute[75285]:     </memballoon>
Nov 10 21:11:53 user nova-compute[75285]:   </devices>
Nov 10 21:11:53 user nova-compute[75285]: </domain>
Nov 10 21:11:53 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:11:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-252199540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-252199540',id=20,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrGHdrWmXZnDobcBkLbJDGNOuNulhOQtjTZ0Td0zuu4Ik7AfZ4rcF63yRHtlxB6ukOXyIp7pnw4VEbd9lzTdIAPD9ZB8MrI5zYYtAh7DVkigItt1bjyVEFS0OXB4+k5sQ==',key_name='tempest-keypair-1489604129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846fec1848ac4cbfa88b60ba0cf98e3c',ramdisk_id='',reservation_id='r-fi8ja34n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-605808320',owner_user_name='tempest-AttachVolumeShelveTestJSON-605808320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:11:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51709428ae324620840611f8eb1c216f',uuid=073785c4-a92c-4297-ab62-55c31b424ffc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converting VIF {"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=e23cea65-b47d-4daf-8640-b3617916099e,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape23cea65-b4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG os_vif [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=e23cea65-b47d-4daf-8640-b3617916099e,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape23cea65-b4') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad174e4e-ab96-586d-9a51-9abc44c24c84', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape23cea65-b4, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape23cea65-b4, col_values=(('qos', UUID('0d67e9a7-2fdd-4d6c-a627-255247706366')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape23cea65-b4, col_values=(('external_ids', {'iface-id': 'e23cea65-b47d-4daf-8640-b3617916099e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:1e:9d', 'vm-uuid': '073785c4-a92c-4297-ab62-55c31b424ffc'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:53 user nova-compute[75285]: INFO os_vif [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=e23cea65-b47d-4daf-8640-b3617916099e,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape23cea65-b4')
Nov 10 21:11:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] No VIF found with MAC fa:16:3e:5b:1e:9d, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG nova.network.neutron [req-58e612b6-bf40-49a1-ba20-e613f8484192 req-dbc5a475-6cc1-40de-843c-ba7327a9a0eb service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Updated VIF entry in instance network info cache for port e23cea65-b47d-4daf-8640-b3617916099e. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG nova.network.neutron [req-58e612b6-bf40-49a1-ba20-e613f8484192 req-dbc5a475-6cc1-40de-843c-ba7327a9a0eb service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Updating instance_info_cache with network_info: [{"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:11:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-58e612b6-bf40-49a1-ba20-e613f8484192 req-dbc5a475-6cc1-40de-843c-ba7327a9a0eb service nova] Releasing lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:11:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:54 user nova-compute[75285]: DEBUG nova.compute.manager [req-8a2669a2-2446-493d-bba2-2a86d9e4a325 req-2ae2ce94-544a-4087-88da-fa450b67e2fa service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received event network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:11:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8a2669a2-2446-493d-bba2-2a86d9e4a325 req-2ae2ce94-544a-4087-88da-fa450b67e2fa service nova] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8a2669a2-2446-493d-bba2-2a86d9e4a325 req-2ae2ce94-544a-4087-88da-fa450b67e2fa service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8a2669a2-2446-493d-bba2-2a86d9e4a325 req-2ae2ce94-544a-4087-88da-fa450b67e2fa service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:54 user nova-compute[75285]: DEBUG nova.compute.manager [req-8a2669a2-2446-493d-bba2-2a86d9e4a325 req-2ae2ce94-544a-4087-88da-fa450b67e2fa service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] No waiting events found dispatching network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:11:54 user nova-compute[75285]: WARNING nova.compute.manager [req-8a2669a2-2446-493d-bba2-2a86d9e4a325 req-2ae2ce94-544a-4087-88da-fa450b67e2fa service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received unexpected event network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e for instance with vm_state building and task_state spawning.
Nov 10 21:11:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:56 user nova-compute[75285]: DEBUG nova.compute.manager [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:11:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:11:56 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Instance spawned successfully.
Nov 10 21:11:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:11:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:11:56 user nova-compute[75285]: INFO nova.compute.manager [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 10 21:11:56 user nova-compute[75285]: DEBUG nova.compute.manager [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:11:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-bcacd493-adef-4935-aa1d-e787a572b846 req-ac7ed323-420b-4445-b959-dcbe75db11d1 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received event network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:11:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bcacd493-adef-4935-aa1d-e787a572b846 req-ac7ed323-420b-4445-b959-dcbe75db11d1 service nova] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bcacd493-adef-4935-aa1d-e787a572b846 req-ac7ed323-420b-4445-b959-dcbe75db11d1 service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bcacd493-adef-4935-aa1d-e787a572b846 req-ac7ed323-420b-4445-b959-dcbe75db11d1 service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-bcacd493-adef-4935-aa1d-e787a572b846 req-ac7ed323-420b-4445-b959-dcbe75db11d1 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] No waiting events found dispatching network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:11:56 user nova-compute[75285]: WARNING nova.compute.manager [req-bcacd493-adef-4935-aa1d-e787a572b846 req-ac7ed323-420b-4445-b959-dcbe75db11d1 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received unexpected event network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e for instance with vm_state building and task_state spawning.
Nov 10 21:11:56 user nova-compute[75285]: INFO nova.compute.manager [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Took 6.59 seconds to build instance.
Nov 10 21:11:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-76d663bc-c9a4-403a-b05b-eb7d001f81ea tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "073785c4-a92c-4297-ab62-55c31b424ffc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.708s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Acquiring lock "6a8d254b-f470-4a0c-8d16-df8ff30e1d39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Lock "6a8d254b-f470-4a0c-8d16-df8ff30e1d39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:11:58 user nova-compute[75285]: INFO nova.compute.claims [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Claim successful on node user
Nov 10 21:11:58 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG nova.network.neutron [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:11:58 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:11:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:11:58 user nova-compute[75285]: INFO nova.virt.block_device [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Booting with volume 617b4db6-30c6-4e9f-b3e8-99f70cb12778 at /dev/vda
Nov 10 21:11:58 user nova-compute[75285]: DEBUG nova.policy [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dc83a1bc4614297a6cafe9fe2266893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa149f33ca7141d4bd735f13e3eb79cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG os_brick.utils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c29092-cefc-41a2-928a-c3696d0f98d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:11:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab36f53-80f4-4b16-96df-cc850e6b99c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[734497e7-e1b0-47af-a8b8-3f0d9c71865f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8007430-158d-4f23-a757-9b6749762e60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:11:59 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:11:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a46e2f4-188c-4235-b3a8-f3a033501ea0]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG os_brick.utils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Updating existing volume attachment record: 9ffdb594-94a7-4ef6-bf34-ce094fb09754 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:11:59 user nova-compute[75285]: DEBUG nova.network.neutron [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Successfully created port: 46c104b1-45c2-4fd8-adee-18f5cd4c48eb {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG nova.network.neutron [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Successfully updated port: 46c104b1-45c2-4fd8-adee-18f5cd4c48eb {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Acquiring lock "refresh_cache-6a8d254b-f470-4a0c-8d16-df8ff30e1d39" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Acquired lock "refresh_cache-6a8d254b-f470-4a0c-8d16-df8ff30e1d39" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG nova.network.neutron [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-89f55211-7b94-40ea-9315-acd35e659778 req-f919bc3c-1cbe-41d3-bca8-85fa7761cd99 service nova] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Received event network-changed-46c104b1-45c2-4fd8-adee-18f5cd4c48eb {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-89f55211-7b94-40ea-9315-acd35e659778 req-f919bc3c-1cbe-41d3-bca8-85fa7761cd99 service nova] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Refreshing instance network info cache due to event network-changed-46c104b1-45c2-4fd8-adee-18f5cd4c48eb. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-89f55211-7b94-40ea-9315-acd35e659778 req-f919bc3c-1cbe-41d3-bca8-85fa7761cd99 service nova] Acquiring lock "refresh_cache-6a8d254b-f470-4a0c-8d16-df8ff30e1d39" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG nova.network.neutron [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:12:00 user nova-compute[75285]: INFO nova.compute.claims [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Claim successful on node user
Nov 10 21:12:00 user nova-compute[75285]: DEBUG nova.network.neutron [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Updating instance_info_cache with network_info: [{"id": "46c104b1-45c2-4fd8-adee-18f5cd4c48eb", "address": "fa:16:3e:1a:cc:2f", "network": {"id": "d3af639d-0cde-4782-8a2c-6cc4e986069d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2057847283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa149f33ca7141d4bd735f13e3eb79cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c104b1-45", "ovs_interfaceid": "46c104b1-45c2-4fd8-adee-18f5cd4c48eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Releasing lock "refresh_cache-6a8d254b-f470-4a0c-8d16-df8ff30e1d39" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Instance network_info: |[{"id": "46c104b1-45c2-4fd8-adee-18f5cd4c48eb", "address": "fa:16:3e:1a:cc:2f", "network": {"id": "d3af639d-0cde-4782-8a2c-6cc4e986069d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2057847283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa149f33ca7141d4bd735f13e3eb79cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c104b1-45", "ovs_interfaceid": "46c104b1-45c2-4fd8-adee-18f5cd4c48eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-89f55211-7b94-40ea-9315-acd35e659778 req-f919bc3c-1cbe-41d3-bca8-85fa7761cd99 service nova] Acquired lock "refresh_cache-6a8d254b-f470-4a0c-8d16-df8ff30e1d39" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:12:00 user nova-compute[75285]: DEBUG nova.network.neutron [req-89f55211-7b94-40ea-9315-acd35e659778 req-f919bc3c-1cbe-41d3-bca8-85fa7761cd99 service nova] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Refreshing network info cache for port 46c104b1-45c2-4fd8-adee-18f5cd4c48eb {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG nova.network.neutron [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:12:01 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:12:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:12:01 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Creating image(s)
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "/opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "/opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG nova.policy [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '353cbd5fff0d4550b72b85c5073ae81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cea5dc310634b9da5042ae70e713b1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG nova.network.neutron [req-89f55211-7b94-40ea-9315-acd35e659778 req-f919bc3c-1cbe-41d3-bca8-85fa7761cd99 service nova] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Updated VIF entry in instance network info cache for port 46c104b1-45c2-4fd8-adee-18f5cd4c48eb. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG nova.network.neutron [req-89f55211-7b94-40ea-9315-acd35e659778 req-f919bc3c-1cbe-41d3-bca8-85fa7761cd99 service nova] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Updating instance_info_cache with network_info: [{"id": "46c104b1-45c2-4fd8-adee-18f5cd4c48eb", "address": "fa:16:3e:1a:cc:2f", "network": {"id": "d3af639d-0cde-4782-8a2c-6cc4e986069d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2057847283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa149f33ca7141d4bd735f13e3eb79cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c104b1-45", "ovs_interfaceid": "46c104b1-45c2-4fd8-adee-18f5cd4c48eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-89f55211-7b94-40ea-9315-acd35e659778 req-f919bc3c-1cbe-41d3-bca8-85fa7761cd99 service nova] Releasing lock "refresh_cache-6a8d254b-f470-4a0c-8d16-df8ff30e1d39" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.190s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk 1073741824" returned: 0 in 0.059s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.190s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG nova.network.neutron [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Successfully created port: 59800b1c-b7d3-43de-a4bc-af7be327714d {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Cannot resize image /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Ensure instance console log exists: /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG nova.network.neutron [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Successfully updated port: 59800b1c-b7d3-43de-a4bc-af7be327714d {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "refresh_cache-3c8c1cd0-d8c4-4efa-ab59-9c451b97646a" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquired lock "refresh_cache-3c8c1cd0-d8c4-4efa-ab59-9c451b97646a" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:12:02 user nova-compute[75285]: DEBUG nova.network.neutron [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-3308fc09-ad26-42b2-b855-bb6cd96b288b req-b3928d1d-27bc-495e-a1f6-f1b6aa0678ce service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Received event network-changed-59800b1c-b7d3-43de-a4bc-af7be327714d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-3308fc09-ad26-42b2-b855-bb6cd96b288b req-b3928d1d-27bc-495e-a1f6-f1b6aa0678ce service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Refreshing instance network info cache due to event network-changed-59800b1c-b7d3-43de-a4bc-af7be327714d. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3308fc09-ad26-42b2-b855-bb6cd96b288b req-b3928d1d-27bc-495e-a1f6-f1b6aa0678ce service nova] Acquiring lock "refresh_cache-3c8c1cd0-d8c4-4efa-ab59-9c451b97646a" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.network.neutron [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.network.neutron [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Updating instance_info_cache with network_info: [{"id": "59800b1c-b7d3-43de-a4bc-af7be327714d", "address": "fa:16:3e:98:1a:23", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59800b1c-b7", "ovs_interfaceid": "59800b1c-b7d3-43de-a4bc-af7be327714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Releasing lock "refresh_cache-3c8c1cd0-d8c4-4efa-ab59-9c451b97646a" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.compute.manager [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Instance network_info: |[{"id": "59800b1c-b7d3-43de-a4bc-af7be327714d", "address": "fa:16:3e:98:1a:23", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59800b1c-b7", "ovs_interfaceid": "59800b1c-b7d3-43de-a4bc-af7be327714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3308fc09-ad26-42b2-b855-bb6cd96b288b req-b3928d1d-27bc-495e-a1f6-f1b6aa0678ce service nova] Acquired lock "refresh_cache-3c8c1cd0-d8c4-4efa-ab59-9c451b97646a" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.network.neutron [req-3308fc09-ad26-42b2-b855-bb6cd96b288b req-b3928d1d-27bc-495e-a1f6-f1b6aa0678ce service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Refreshing network info cache for port 59800b1c-b7d3-43de-a4bc-af7be327714d {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Start _get_guest_xml network_info=[{"id": "59800b1c-b7d3-43de-a4bc-af7be327714d", "address": "fa:16:3e:98:1a:23", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59800b1c-b7", "ovs_interfaceid": "59800b1c-b7d3-43de-a4bc-af7be327714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:12:03 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:12:03 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:11:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1823256661',display_name='tempest-ServersNegativeTestJSON-server-1823256661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1823256661',id=22,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cea5dc310634b9da5042ae70e713b1e',ramdisk_id='',reservation_id='r-ygv9wtiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-957099376',owner_user_name='tempest-ServersNegativeTestJSON-957099376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:12:01Z,user_data=None,user_id='353cbd5fff0d4550b72b85c5073ae81d',uuid=3c8c1cd0-d8c4-4efa-ab59-9c451b97646a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59800b1c-b7d3-43de-a4bc-af7be327714d", "address": "fa:16:3e:98:1a:23", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59800b1c-b7", "ovs_interfaceid": "59800b1c-b7d3-43de-a4bc-af7be327714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Converting VIF {"id": "59800b1c-b7d3-43de-a4bc-af7be327714d", "address": "fa:16:3e:98:1a:23", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59800b1c-b7", "ovs_interfaceid": "59800b1c-b7d3-43de-a4bc-af7be327714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:1a:23,bridge_name='br-int',has_traffic_filtering=True,id=59800b1c-b7d3-43de-a4bc-af7be327714d,network=Network(28e1d97a-a55b-41d2-83d4-600aedcecb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59800b1c-b7') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.objects.instance [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:12:03 user nova-compute[75285]:   <uuid>3c8c1cd0-d8c4-4efa-ab59-9c451b97646a</uuid>
Nov 10 21:12:03 user nova-compute[75285]:   <name>instance-00000016</name>
Nov 10 21:12:03 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:12:03 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:12:03 user nova-compute[75285]:   <metadata>
Nov 10 21:12:03 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:12:03 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:12:03 user nova-compute[75285]:       <nova:name>tempest-ServersNegativeTestJSON-server-1823256661</nova:name>
Nov 10 21:12:03 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:12:03</nova:creationTime>
Nov 10 21:12:03 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:12:03 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:12:03 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:12:03 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:12:03 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:12:03 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:12:03 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:12:03 user nova-compute[75285]:       <nova:owner>
Nov 10 21:12:03 user nova-compute[75285]:         <nova:user uuid="353cbd5fff0d4550b72b85c5073ae81d">tempest-ServersNegativeTestJSON-957099376-project-member</nova:user>
Nov 10 21:12:03 user nova-compute[75285]:         <nova:project uuid="1cea5dc310634b9da5042ae70e713b1e">tempest-ServersNegativeTestJSON-957099376</nova:project>
Nov 10 21:12:03 user nova-compute[75285]:       </nova:owner>
Nov 10 21:12:03 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:12:03 user nova-compute[75285]:       <nova:ports>
Nov 10 21:12:03 user nova-compute[75285]:         <nova:port uuid="59800b1c-b7d3-43de-a4bc-af7be327714d">
Nov 10 21:12:03 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 21:12:03 user nova-compute[75285]:         </nova:port>
Nov 10 21:12:03 user nova-compute[75285]:       </nova:ports>
Nov 10 21:12:03 user nova-compute[75285]:     </nova:instance>
Nov 10 21:12:03 user nova-compute[75285]:   </metadata>
Nov 10 21:12:03 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:12:03 user nova-compute[75285]:     <system>
Nov 10 21:12:03 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:12:03 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:12:03 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:12:03 user nova-compute[75285]:       <entry name="serial">3c8c1cd0-d8c4-4efa-ab59-9c451b97646a</entry>
Nov 10 21:12:03 user nova-compute[75285]:       <entry name="uuid">3c8c1cd0-d8c4-4efa-ab59-9c451b97646a</entry>
Nov 10 21:12:03 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:12:03 user nova-compute[75285]:     </system>
Nov 10 21:12:03 user nova-compute[75285]:   </sysinfo>
Nov 10 21:12:03 user nova-compute[75285]:   <os>
Nov 10 21:12:03 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:12:03 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:12:03 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:12:03 user nova-compute[75285]:   </os>
Nov 10 21:12:03 user nova-compute[75285]:   <features>
Nov 10 21:12:03 user nova-compute[75285]:     <acpi/>
Nov 10 21:12:03 user nova-compute[75285]:     <apic/>
Nov 10 21:12:03 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:12:03 user nova-compute[75285]:   </features>
Nov 10 21:12:03 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:12:03 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:12:03 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:12:03 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:12:03 user nova-compute[75285]:   </clock>
Nov 10 21:12:03 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:12:03 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:12:03 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:12:03 user nova-compute[75285]:   </cpu>
Nov 10 21:12:03 user nova-compute[75285]:   <devices>
Nov 10 21:12:03 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:12:03 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:12:03 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk"/>
Nov 10 21:12:03 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:12:03 user nova-compute[75285]:     </disk>
Nov 10 21:12:03 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:12:03 user nova-compute[75285]:       <mac address="fa:16:3e:98:1a:23"/>
Nov 10 21:12:03 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:12:03 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:12:03 user nova-compute[75285]:       <target dev="tap59800b1c-b7"/>
Nov 10 21:12:03 user nova-compute[75285]:     </interface>
Nov 10 21:12:03 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:12:03 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/console.log" append="off"/>
Nov 10 21:12:03 user nova-compute[75285]:     </serial>
Nov 10 21:12:03 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:12:03 user nova-compute[75285]:     <video>
Nov 10 21:12:03 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:12:03 user nova-compute[75285]:     </video>
Nov 10 21:12:03 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:12:03 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:12:03 user nova-compute[75285]:     </rng>
Nov 10 21:12:03 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:12:03 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:12:03 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:12:03 user nova-compute[75285]:     </memballoon>
Nov 10 21:12:03 user nova-compute[75285]:   </devices>
Nov 10 21:12:03 user nova-compute[75285]: </domain>
Nov 10 21:12:03 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:11:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1823256661',display_name='tempest-ServersNegativeTestJSON-server-1823256661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1823256661',id=22,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cea5dc310634b9da5042ae70e713b1e',ramdisk_id='',reservation_id='r-ygv9wtiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-957099376',owner_user_name='tempest-ServersNegativeTestJSON-957099376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:12:01Z,user_data=None,user_id='353cbd5fff0d4550b72b85c5073ae81d',uuid=3c8c1cd0-d8c4-4efa-ab59-9c451b97646a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59800b1c-b7d3-43de-a4bc-af7be327714d", "address": "fa:16:3e:98:1a:23", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59800b1c-b7", "ovs_interfaceid": "59800b1c-b7d3-43de-a4bc-af7be327714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Converting VIF {"id": "59800b1c-b7d3-43de-a4bc-af7be327714d", "address": "fa:16:3e:98:1a:23", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59800b1c-b7", "ovs_interfaceid": "59800b1c-b7d3-43de-a4bc-af7be327714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:1a:23,bridge_name='br-int',has_traffic_filtering=True,id=59800b1c-b7d3-43de-a4bc-af7be327714d,network=Network(28e1d97a-a55b-41d2-83d4-600aedcecb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59800b1c-b7') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG os_vif [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:1a:23,bridge_name='br-int',has_traffic_filtering=True,id=59800b1c-b7d3-43de-a4bc-af7be327714d,network=Network(28e1d97a-a55b-41d2-83d4-600aedcecb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59800b1c-b7') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23a568bd-3fa5-51bc-a5ca-3a7b49581b93', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59800b1c-b7, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59800b1c-b7, col_values=(('qos', UUID('1e6081f3-a7fb-4dde-b1a3-15c43a222a6b')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59800b1c-b7, col_values=(('external_ids', {'iface-id': '59800b1c-b7d3-43de-a4bc-af7be327714d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:1a:23', 'vm-uuid': '3c8c1cd0-d8c4-4efa-ab59-9c451b97646a'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:03 user nova-compute[75285]: INFO os_vif [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:1a:23,bridge_name='br-int',has_traffic_filtering=True,id=59800b1c-b7d3-43de-a4bc-af7be327714d,network=Network(28e1d97a-a55b-41d2-83d4-600aedcecb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59800b1c-b7')
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] No VIF found with MAC fa:16:3e:98:1a:23, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.network.neutron [req-3308fc09-ad26-42b2-b855-bb6cd96b288b req-b3928d1d-27bc-495e-a1f6-f1b6aa0678ce service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Updated VIF entry in instance network info cache for port 59800b1c-b7d3-43de-a4bc-af7be327714d. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG nova.network.neutron [req-3308fc09-ad26-42b2-b855-bb6cd96b288b req-b3928d1d-27bc-495e-a1f6-f1b6aa0678ce service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Updating instance_info_cache with network_info: [{"id": "59800b1c-b7d3-43de-a4bc-af7be327714d", "address": "fa:16:3e:98:1a:23", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59800b1c-b7", "ovs_interfaceid": "59800b1c-b7d3-43de-a4bc-af7be327714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3308fc09-ad26-42b2-b855-bb6cd96b288b req-b3928d1d-27bc-495e-a1f6-f1b6aa0678ce service nova] Releasing lock "refresh_cache-3c8c1cd0-d8c4-4efa-ab59-9c451b97646a" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:12:04 user nova-compute[75285]: DEBUG nova.compute.manager [req-9aa3e317-3ea7-4065-92ed-779c7b56c481 req-ce855efd-1a0b-4175-91e0-c9019f809979 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-changed-a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:04 user nova-compute[75285]: DEBUG nova.compute.manager [req-9aa3e317-3ea7-4065-92ed-779c7b56c481 req-ce855efd-1a0b-4175-91e0-c9019f809979 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing instance network info cache due to event network-changed-a4ec5316-300f-4095-b774-485c613db4d9. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:12:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9aa3e317-3ea7-4065-92ed-779c7b56c481 req-ce855efd-1a0b-4175-91e0-c9019f809979 service nova] Acquiring lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:12:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9aa3e317-3ea7-4065-92ed-779c7b56c481 req-ce855efd-1a0b-4175-91e0-c9019f809979 service nova] Acquired lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:12:04 user nova-compute[75285]: DEBUG nova.network.neutron [req-9aa3e317-3ea7-4065-92ed-779c7b56c481 req-ce855efd-1a0b-4175-91e0-c9019f809979 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Refreshing network info cache for port a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:12:04 user nova-compute[75285]: DEBUG nova.network.neutron [req-9aa3e317-3ea7-4065-92ed-779c7b56c481 req-ce855efd-1a0b-4175-91e0-c9019f809979 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updated VIF entry in instance network info cache for port a4ec5316-300f-4095-b774-485c613db4d9. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:12:04 user nova-compute[75285]: DEBUG nova.network.neutron [req-9aa3e317-3ea7-4065-92ed-779c7b56c481 req-ce855efd-1a0b-4175-91e0-c9019f809979 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [{"id": "a4ec5316-300f-4095-b774-485c613db4d9", "address": "fa:16:3e:ae:bb:98", "network": {"id": "fe43178e-f9ea-4eb5-ae15-475ddd073359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562639401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec5316-30", "ovs_interfaceid": "a4ec5316-300f-4095-b774-485c613db4d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "address": "fa:16:3e:36:33:41", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e593-07", "ovs_interfaceid": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "address": "fa:16:3e:e9:56:81", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19633a5-3e", "ovs_interfaceid": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "address": "fa:16:3e:9b:ac:12", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3496e5b6-03", "ovs_interfaceid": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9aa3e317-3ea7-4065-92ed-779c7b56c481 req-ce855efd-1a0b-4175-91e0-c9019f809979 service nova] Releasing lock "refresh_cache-26bec53a-de52-4a18-b778-8f917cace2dd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:12:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:06 user nova-compute[75285]: DEBUG nova.compute.manager [req-dac65571-d437-42fb-a695-de1edc7efb6d req-02eb7de2-ac06-4d94-be56-2b6a359b6860 service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Received event network-vif-plugged-59800b1c-b7d3-43de-a4bc-af7be327714d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-dac65571-d437-42fb-a695-de1edc7efb6d req-02eb7de2-ac06-4d94-be56-2b6a359b6860 service nova] Acquiring lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-dac65571-d437-42fb-a695-de1edc7efb6d req-02eb7de2-ac06-4d94-be56-2b6a359b6860 service nova] Lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-dac65571-d437-42fb-a695-de1edc7efb6d req-02eb7de2-ac06-4d94-be56-2b6a359b6860 service nova] Lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:06 user nova-compute[75285]: DEBUG nova.compute.manager [req-dac65571-d437-42fb-a695-de1edc7efb6d req-02eb7de2-ac06-4d94-be56-2b6a359b6860 service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] No waiting events found dispatching network-vif-plugged-59800b1c-b7d3-43de-a4bc-af7be327714d {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:06 user nova-compute[75285]: WARNING nova.compute.manager [req-dac65571-d437-42fb-a695-de1edc7efb6d req-02eb7de2-ac06-4d94-be56-2b6a359b6860 service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Received unexpected event network-vif-plugged-59800b1c-b7d3-43de-a4bc-af7be327714d for instance with vm_state building and task_state spawning.
Nov 10 21:12:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "26bec53a-de52-4a18-b778-8f917cace2dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:07 user nova-compute[75285]: INFO nova.compute.manager [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Terminating instance
Nov 10 21:12:07 user nova-compute[75285]: DEBUG nova.compute.manager [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-ca2dc338-b249-4244-8921-c065556cf774 req-2136cc7f-1ce7-452f-97f9-cd38878c1ceb service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-unplugged-a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ca2dc338-b249-4244-8921-c065556cf774 req-2136cc7f-1ce7-452f-97f9-cd38878c1ceb service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ca2dc338-b249-4244-8921-c065556cf774 req-2136cc7f-1ce7-452f-97f9-cd38878c1ceb service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ca2dc338-b249-4244-8921-c065556cf774 req-2136cc7f-1ce7-452f-97f9-cd38878c1ceb service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-ca2dc338-b249-4244-8921-c065556cf774 req-2136cc7f-1ce7-452f-97f9-cd38878c1ceb service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-unplugged-a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-ca2dc338-b249-4244-8921-c065556cf774 req-2136cc7f-1ce7-452f-97f9-cd38878c1ceb service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-unplugged-a4ec5316-300f-4095-b774-485c613db4d9 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-42359c24-63b3-424b-bd8c-72b59847558c req-bc1ff874-18f9-4cd3-bb33-1ed39cef7107 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-unplugged-fb52e593-077b-4368-93c0-aa9e1ad6717f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-42359c24-63b3-424b-bd8c-72b59847558c req-bc1ff874-18f9-4cd3-bb33-1ed39cef7107 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-42359c24-63b3-424b-bd8c-72b59847558c req-bc1ff874-18f9-4cd3-bb33-1ed39cef7107 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-42359c24-63b3-424b-bd8c-72b59847558c req-bc1ff874-18f9-4cd3-bb33-1ed39cef7107 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-42359c24-63b3-424b-bd8c-72b59847558c req-bc1ff874-18f9-4cd3-bb33-1ed39cef7107 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-unplugged-fb52e593-077b-4368-93c0-aa9e1ad6717f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-42359c24-63b3-424b-bd8c-72b59847558c req-bc1ff874-18f9-4cd3-bb33-1ed39cef7107 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-unplugged-fb52e593-077b-4368-93c0-aa9e1ad6717f for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:12:08 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Instance spawned successfully.
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.compute.manager [req-cbe8d02b-72d9-496c-85fc-2d2232889080 req-965ef01d-12ff-4af3-b638-320e7177fb34 service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Received event network-vif-plugged-59800b1c-b7d3-43de-a4bc-af7be327714d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cbe8d02b-72d9-496c-85fc-2d2232889080 req-965ef01d-12ff-4af3-b638-320e7177fb34 service nova] Acquiring lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cbe8d02b-72d9-496c-85fc-2d2232889080 req-965ef01d-12ff-4af3-b638-320e7177fb34 service nova] Lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cbe8d02b-72d9-496c-85fc-2d2232889080 req-965ef01d-12ff-4af3-b638-320e7177fb34 service nova] Lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.compute.manager [req-cbe8d02b-72d9-496c-85fc-2d2232889080 req-965ef01d-12ff-4af3-b638-320e7177fb34 service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] No waiting events found dispatching network-vif-plugged-59800b1c-b7d3-43de-a4bc-af7be327714d {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:08 user nova-compute[75285]: WARNING nova.compute.manager [req-cbe8d02b-72d9-496c-85fc-2d2232889080 req-965ef01d-12ff-4af3-b638-320e7177fb34 service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Received unexpected event network-vif-plugged-59800b1c-b7d3-43de-a4bc-af7be327714d for instance with vm_state building and task_state spawning.
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:08 user nova-compute[75285]: INFO nova.compute.manager [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Took 6.78 seconds to spawn the instance on the hypervisor.
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:08 user nova-compute[75285]: INFO nova.compute.manager [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Took 7.75 seconds to build instance.
Nov 10 21:12:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f368015-cb20-41d4-a605-a6859127d6cc tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.888s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:08 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Instance destroyed successfully.
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.objects.instance [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lazy-loading 'resources' on Instance uuid 26bec53a-de52-4a18-b778-8f917cace2dd {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4ec5316-300f-4095-b774-485c613db4d9", "address": "fa:16:3e:ae:bb:98", "network": {"id": "fe43178e-f9ea-4eb5-ae15-475ddd073359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562639401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec5316-30", "ovs_interfaceid": "a4ec5316-300f-4095-b774-485c613db4d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "a4ec5316-300f-4095-b774-485c613db4d9", "address": "fa:16:3e:ae:bb:98", "network": {"id": "fe43178e-f9ea-4eb5-ae15-475ddd073359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562639401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec5316-30", "ovs_interfaceid": "a4ec5316-300f-4095-b774-485c613db4d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:bb:98,bridge_name='br-int',has_traffic_filtering=True,id=a4ec5316-300f-4095-b774-485c613db4d9,network=Network(fe43178e-f9ea-4eb5-ae15-475ddd073359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ec5316-30') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG os_vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:bb:98,bridge_name='br-int',has_traffic_filtering=True,id=a4ec5316-300f-4095-b774-485c613db4d9,network=Network(fe43178e-f9ea-4eb5-ae15-475ddd073359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ec5316-30') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4ec5316-30, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98ccfb4d-edb8-434d-be08-4640fccb4c17) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: INFO os_vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:bb:98,bridge_name='br-int',has_traffic_filtering=True,id=a4ec5316-300f-4095-b774-485c613db4d9,network=Network(fe43178e-f9ea-4eb5-ae15-475ddd073359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ec5316-30')
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:75:63,bridge_name='br-int',has_traffic_filtering=True,id=2d4174d5-1be7-4753-a29c-a3ed22b4af19,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d4174d5-1b') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:75:63,bridge_name='br-int',has_traffic_filtering=True,id=2d4174d5-1be7-4753-a29c-a3ed22b4af19,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d4174d5-1b') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d4174d5-1b, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54fccf6e-36bb-4fd6-9d0b-3af35590fcc7) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: INFO os_vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:75:63,bridge_name='br-int',has_traffic_filtering=True,id=2d4174d5-1be7-4753-a29c-a3ed22b4af19,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d4174d5-1b')
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:11:6a,bridge_name='br-int',has_traffic_filtering=True,id=72df5ae8-22f3-4870-993a-19137df8e682,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72df5ae8-22') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:11:6a,bridge_name='br-int',has_traffic_filtering=True,id=72df5ae8-22f3-4870-993a-19137df8e682,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72df5ae8-22') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72df5ae8-22, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a464c17c-4bae-4293-9c46-aebab671635a) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: INFO os_vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:11:6a,bridge_name='br-int',has_traffic_filtering=True,id=72df5ae8-22f3-4870-993a-19137df8e682,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72df5ae8-22')
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "address": "fa:16:3e:36:33:41", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e593-07", "ovs_interfaceid": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "address": "fa:16:3e:36:33:41", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb52e593-07", "ovs_interfaceid": "fb52e593-077b-4368-93c0-aa9e1ad6717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:33:41,bridge_name='br-int',has_traffic_filtering=True,id=fb52e593-077b-4368-93c0-aa9e1ad6717f,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb52e593-07') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:33:41,bridge_name='br-int',has_traffic_filtering=True,id=fb52e593-077b-4368-93c0-aa9e1ad6717f,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb52e593-07') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb52e593-07, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a3b97e5-9648-47b7-81e1-4a0ae4b72428) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: INFO os_vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:33:41,bridge_name='br-int',has_traffic_filtering=True,id=fb52e593-077b-4368-93c0-aa9e1ad6717f,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb52e593-07')
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "address": "fa:16:3e:e9:56:81", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19633a5-3e", "ovs_interfaceid": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "address": "fa:16:3e:e9:56:81", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19633a5-3e", "ovs_interfaceid": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:56:81,bridge_name='br-int',has_traffic_filtering=True,id=e19633a5-3e53-4b50-8b33-ec86a745a45d,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape19633a5-3e') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:56:81,bridge_name='br-int',has_traffic_filtering=True,id=e19633a5-3e53-4b50-8b33-ec86a745a45d,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape19633a5-3e') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape19633a5-3e, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a23a667-748c-446f-be56-5259f4ab5776) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:09 user nova-compute[75285]: WARNING nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-a4ec5316-300f-4095-b774-485c613db4d9 for instance with vm_state active and task_state deleting.
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-unplugged-2d4174d5-1be7-4753-a29c-a3ed22b4af19 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-unplugged-2d4174d5-1be7-4753-a29c-a3ed22b4af19 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-unplugged-2d4174d5-1be7-4753-a29c-a3ed22b4af19 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-2d4174d5-1be7-4753-a29c-a3ed22b4af19 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-2d4174d5-1be7-4753-a29c-a3ed22b4af19 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:09 user nova-compute[75285]: WARNING nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-2d4174d5-1be7-4753-a29c-a3ed22b4af19 for instance with vm_state active and task_state deleting.
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-unplugged-72df5ae8-22f3-4870-993a-19137df8e682 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-unplugged-72df5ae8-22f3-4870-993a-19137df8e682 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-unplugged-72df5ae8-22f3-4870-993a-19137df8e682 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-72df5ae8-22f3-4870-993a-19137df8e682 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-72df5ae8-22f3-4870-993a-19137df8e682 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:09 user nova-compute[75285]: WARNING nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-72df5ae8-22f3-4870-993a-19137df8e682 for instance with vm_state active and task_state deleting.
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-unplugged-e19633a5-3e53-4b50-8b33-ec86a745a45d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-unplugged-e19633a5-3e53-4b50-8b33-ec86a745a45d {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-unplugged-e19633a5-3e53-4b50-8b33-ec86a745a45d for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-e19633a5-3e53-4b50-8b33-ec86a745a45d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-e19633a5-3e53-4b50-8b33-ec86a745a45d {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:09 user nova-compute[75285]: WARNING nova.compute.manager [req-719251e6-555b-40c7-b6e8-1b02c24e7bef req-a007aeaf-d639-46b9-a51c-d078c2f77312 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-e19633a5-3e53-4b50-8b33-ec86a745a45d for instance with vm_state active and task_state deleting.
Nov 10 21:12:09 user nova-compute[75285]: INFO os_vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:56:81,bridge_name='br-int',has_traffic_filtering=True,id=e19633a5-3e53-4b50-8b33-ec86a745a45d,network=Network(417a034c-d7ae-4ed8-b8af-5718bd7f8e86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape19633a5-3e')
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:bf:eb,bridge_name='br-int',has_traffic_filtering=True,id=bd2b2398-97ca-4072-b5d8-905d2011fd16,network=Network(f1c2109f-a578-4e2a-86ae-7b6451db9280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd2b2398-97') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:bf:eb,bridge_name='br-int',has_traffic_filtering=True,id=bd2b2398-97ca-4072-b5d8-905d2011fd16,network=Network(f1c2109f-a578-4e2a-86ae-7b6451db9280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd2b2398-97') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd2b2398-97, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e37b615f-1537-478b-8258-b05c426ba16c) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: INFO os_vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:bf:eb,bridge_name='br-int',has_traffic_filtering=True,id=bd2b2398-97ca-4072-b5d8-905d2011fd16,network=Network(f1c2109f-a578-4e2a-86ae-7b6451db9280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd2b2398-97')
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T21:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-108163155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-108163155',id=16,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVg70FOaG9vw3JGVshsyAixhAFrgX9uqo2yRn5pY64nYv5DVDAbvRv/X22SNXSlcgZUX+pF53yW//pFDSK1/YS6O0vLpRGt7V/K/rT+y08GgsCsZhPt6eR2JKWNdXKYBw==',key_name='tempest-keypair-1475304574',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='415f8f5d956148b7ad22cd31c04ceb37',ramdisk_id='',reservation_id='r-fn4tk0dx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-529276018',owner_user_name='tempest-TaggedBootDevicesTest-529276018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='934f46eb81fc4e1fb900b25a7e9500c5',uuid=26bec53a-de52-4a18-b778-8f917cace2dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "address": "fa:16:3e:9b:ac:12", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3496e5b6-03", "ovs_interfaceid": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converting VIF {"id": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "address": "fa:16:3e:9b:ac:12", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3496e5b6-03", "ovs_interfaceid": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=3496e5b6-03c7-4c7b-9a71-932ed44c1b5e,network=Network(f1c2109f-a578-4e2a-86ae-7b6451db9280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3496e5b6-03') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=3496e5b6-03c7-4c7b-9a71-932ed44c1b5e,network=Network(f1c2109f-a578-4e2a-86ae-7b6451db9280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3496e5b6-03') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3496e5b6-03, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57f6dcd3-4006-49d0-a6bc-26c755cc1a7d) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:12:09 user nova-compute[75285]: INFO os_vif [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ac:12,bridge_name='br-int',has_traffic_filtering=True,id=3496e5b6-03c7-4c7b-9a71-932ed44c1b5e,network=Network(f1c2109f-a578-4e2a-86ae-7b6451db9280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3496e5b6-03')
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUiHXWxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:12:09 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1fdd44-c13c-465a-a58a-17fcf7604584]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:12:09 user nova-compute[75285]: No targets found.
Nov 10 21:12:09 user nova-compute[75285]: iSNS:
Nov 10 21:12:09 user nova-compute[75285]: No targets found.
Nov 10 21:12:09 user nova-compute[75285]: STATIC:
Nov 10 21:12:09 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc
Nov 10 21:12:09 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:12:09 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:12:09 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8
Nov 10 21:12:09 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:12:09 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:12:09 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5
Nov 10 21:12:09 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:12:09 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:12:09 user nova-compute[75285]: FIRMWARE:
Nov 10 21:12:09 user nova-compute[75285]: No targets found.
Nov 10 21:12:09 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:12:09 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:12:09 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef4b0ca-a9b4-4cad-b396-3a06ac80fc71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f216ab-bb3f-4e30-890f-8a24a62f4461]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)
Nov 10 21:12:09 user nova-compute[75285]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)
Nov 10 21:12:09 user nova-compute[75285]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)
Nov 10 21:12:09 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 (non-flash)
Nov 10 21:12:09 user nova-compute[75285]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)
Nov 10 21:12:09 user nova-compute[75285]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)
Nov 10 21:12:09 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e46d4700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeae8986-8b23-4160-8570-4285f51aaa4d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[90715d4a-10eb-410d-98c5-e71d328545da]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc164483-464e-4fb1-a848-343432c72c01]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-fb52e593-077b-4368-93c0-aa9e1ad6717f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-fb52e593-077b-4368-93c0-aa9e1ad6717f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:09 user nova-compute[75285]: WARNING nova.compute.manager [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-fb52e593-077b-4368-93c0-aa9e1ad6717f for instance with vm_state active and task_state deleting.
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-unplugged-bd2b2398-97ca-4072-b5d8-905d2011fd16 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-unplugged-bd2b2398-97ca-4072-b5d8-905d2011fd16 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-unplugged-bd2b2398-97ca-4072-b5d8-905d2011fd16 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-bd2b2398-97ca-4072-b5d8-905d2011fd16 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-bd2b2398-97ca-4072-b5d8-905d2011fd16 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:09 user nova-compute[75285]: WARNING nova.compute.manager [req-557867f2-9b8e-4704-b82a-2063d1554043 req-08df9921-a50b-4f54-ae58-e0917e687ad3 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-bd2b2398-97ca-4072-b5d8-905d2011fd16 for instance with vm_state active and task_state deleting.
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4570eea3-75a2-4a0c-9110-576e6e767ac4]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8755e3-6032-4d34-b248-ce006679f3fa]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:12:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f470142b-ebe2-4bd6-b3e1-82a75e1ee079]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8, portal: 172.16.0.220,3260]
Nov 10 21:12:10 user nova-compute[75285]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8, portal: 172.16.0.220,3260] successful.
Nov 10 21:12:10 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64430c41-05b2-4af5-8bd9-fb3888479da8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9ce215-bcd3-452a-92e6-ac99fec81420]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] <== disconnect_volume: return (387ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BIEknORH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:12:10 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e9c36d-07d6-4bfe-82e8-a76550b08f93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:12:10 user nova-compute[75285]: No targets found.
Nov 10 21:12:10 user nova-compute[75285]: iSNS:
Nov 10 21:12:10 user nova-compute[75285]: No targets found.
Nov 10 21:12:10 user nova-compute[75285]: STATIC:
Nov 10 21:12:10 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc
Nov 10 21:12:10 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:12:10 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:12:10 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5
Nov 10 21:12:10 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:12:10 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:12:10 user nova-compute[75285]: FIRMWARE:
Nov 10 21:12:10 user nova-compute[75285]: No targets found.
Nov 10 21:12:10 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:12:10 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:12:10 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74d88a6-8289-4559-b796-2bc4539c9493]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e4d329-b810-46a0-89cf-5c3687c9243d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)
Nov 10 21:12:10 user nova-compute[75285]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)
Nov 10 21:12:10 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc (non-flash)
Nov 10 21:12:10 user nova-compute[75285]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)
Nov 10 21:12:10 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e46d4700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc'): ({'sdd'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Removing single pathed devices sdd {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfa9199-0386-4cae-895c-bc324328b9bb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc11213f-a8c2-40bd-a95b-6703cb16c196]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Flushing IO for device /dev/sdd {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-23d4cd67-b9b5-4e17-89dd-606dbe6aff5b req-cf6e9dcd-2f3c-4067-b9d0-7cf851fc7de2 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-unplugged-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-23d4cd67-b9b5-4e17-89dd-606dbe6aff5b req-cf6e9dcd-2f3c-4067-b9d0-7cf851fc7de2 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-23d4cd67-b9b5-4e17-89dd-606dbe6aff5b req-cf6e9dcd-2f3c-4067-b9d0-7cf851fc7de2 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-23d4cd67-b9b5-4e17-89dd-606dbe6aff5b req-cf6e9dcd-2f3c-4067-b9d0-7cf851fc7de2 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-23d4cd67-b9b5-4e17-89dd-606dbe6aff5b req-cf6e9dcd-2f3c-4067-b9d0-7cf851fc7de2 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-unplugged-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-23d4cd67-b9b5-4e17-89dd-606dbe6aff5b req-cf6e9dcd-2f3c-4067-b9d0-7cf851fc7de2 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-unplugged-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-23d4cd67-b9b5-4e17-89dd-606dbe6aff5b req-cf6e9dcd-2f3c-4067-b9d0-7cf851fc7de2 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-plugged-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-23d4cd67-b9b5-4e17-89dd-606dbe6aff5b req-cf6e9dcd-2f3c-4067-b9d0-7cf851fc7de2 service nova] Acquiring lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-23d4cd67-b9b5-4e17-89dd-606dbe6aff5b req-cf6e9dcd-2f3c-4067-b9d0-7cf851fc7de2 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-23d4cd67-b9b5-4e17-89dd-606dbe6aff5b req-cf6e9dcd-2f3c-4067-b9d0-7cf851fc7de2 service nova] Lock "26bec53a-de52-4a18-b778-8f917cace2dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-23d4cd67-b9b5-4e17-89dd-606dbe6aff5b req-cf6e9dcd-2f3c-4067-b9d0-7cf851fc7de2 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] No waiting events found dispatching network-vif-plugged-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:12:10 user nova-compute[75285]: WARNING nova.compute.manager [req-23d4cd67-b9b5-4e17-89dd-606dbe6aff5b req-cf6e9dcd-2f3c-4067-b9d0-7cf851fc7de2 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received unexpected event network-vif-plugged-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e for instance with vm_state active and task_state deleting.
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d6fb17-e1b2-40d5-9e82-73f3d3fd641f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74be14a-c971-453e-b775-8c467087428e]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] SCSI volumes sdd have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6630a3b-c875-45c9-a6ce-69b7fe6127c0]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e457af9-a4f3-46a9-a2d8-0aa1b2b41df6]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc, portal: 172.16.0.220,3260]
Nov 10 21:12:10 user nova-compute[75285]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc, portal: 172.16.0.220,3260] successful.
Nov 10 21:12:10 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17437102-0775-48a0-b172-b76e3225bcfc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[af28a911-340e-4ff8-a9cf-3b0cbee75cd6]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] <== disconnect_volume: return (364ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCwJboqv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:12:10 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c295ce10-3614-4b5b-828e-8ff68289ebb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:12:10 user nova-compute[75285]: No targets found.
Nov 10 21:12:10 user nova-compute[75285]: iSNS:
Nov 10 21:12:10 user nova-compute[75285]: No targets found.
Nov 10 21:12:10 user nova-compute[75285]: STATIC:
Nov 10 21:12:10 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5
Nov 10 21:12:10 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:12:10 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:12:10 user nova-compute[75285]: FIRMWARE:
Nov 10 21:12:10 user nova-compute[75285]: No targets found.
Nov 10 21:12:10 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:12:10 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:12:10 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dba0bf-bcc1-4773-9b46-a4869eb95c63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[553de6ee-72b8-450b-83f9-3f6e946156a0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)
Nov 10 21:12:10 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 (non-flash)
Nov 10 21:12:10 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e46dd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5'): ({'sde'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Removing single pathed devices sde {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[69483bac-be08-47f8-8d74-ffd88207d881]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51fbb56-2fdc-40f9-9f4b-822b83759f66]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Flushing IO for device /dev/sde {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaa6917-475a-452a-8cff-de55c8c5d206]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb88f26-157c-4b1b-840d-52e6bf2e1d7c]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] SCSI volumes sde have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c20e04-8716-4a8b-be66-64cb073b0a9f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33514ac-2aa7-4ead-9268-d94974588467]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5, portal: 172.16.0.220,3260]
Nov 10 21:12:10 user nova-compute[75285]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5, portal: 172.16.0.220,3260] successful.
Nov 10 21:12:10 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfc2e782-14e0-426f-8a4e-5ac4a032bcc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bef50e0-cc59-433c-95dc-dfb2a17c6db8]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] <== disconnect_volume: return (335ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:12:10 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Deleting instance files /opt/stack/data/nova/instances/26bec53a-de52-4a18-b778-8f917cace2dd_del
Nov 10 21:12:10 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Deletion of /opt/stack/data/nova/instances/26bec53a-de52-4a18-b778-8f917cace2dd_del complete
Nov 10 21:12:10 user nova-compute[75285]: INFO nova.compute.manager [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Took 3.87 seconds to destroy the instance on the hypervisor.
Nov 10 21:12:10 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:12:10 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:12:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:12 user nova-compute[75285]: DEBUG nova.compute.manager [req-c6a6a037-9f6f-47b8-827f-8ef566d0d244 req-1f5a3b08-039e-4e17-9d3e-759c17bfbe63 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-deleted-fb52e593-077b-4368-93c0-aa9e1ad6717f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:12 user nova-compute[75285]: INFO nova.compute.manager [req-c6a6a037-9f6f-47b8-827f-8ef566d0d244 req-1f5a3b08-039e-4e17-9d3e-759c17bfbe63 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Neutron deleted interface fb52e593-077b-4368-93c0-aa9e1ad6717f; detaching it from the instance and deleting it from the info cache
Nov 10 21:12:12 user nova-compute[75285]: DEBUG nova.network.neutron [req-c6a6a037-9f6f-47b8-827f-8ef566d0d244 req-1f5a3b08-039e-4e17-9d3e-759c17bfbe63 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [{"id": "a4ec5316-300f-4095-b774-485c613db4d9", "address": "fa:16:3e:ae:bb:98", "network": {"id": "fe43178e-f9ea-4eb5-ae15-475ddd073359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562639401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec5316-30", "ovs_interfaceid": "a4ec5316-300f-4095-b774-485c613db4d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "address": "fa:16:3e:e9:56:81", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19633a5-3e", "ovs_interfaceid": "e19633a5-3e53-4b50-8b33-ec86a745a45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "address": "fa:16:3e:9b:ac:12", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3496e5b6-03", "ovs_interfaceid": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:12 user nova-compute[75285]: DEBUG nova.compute.manager [req-c6a6a037-9f6f-47b8-827f-8ef566d0d244 req-1f5a3b08-039e-4e17-9d3e-759c17bfbe63 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Detach interface failed, port_id=fb52e593-077b-4368-93c0-aa9e1ad6717f, reason: Instance 26bec53a-de52-4a18-b778-8f917cace2dd could not be found. {{(pid=75285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 21:12:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-0ab01630-525f-4f54-8a57-9accd9dee5c5 req-622bcace-a254-455d-92c7-fb80584dfc3a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-deleted-e19633a5-3e53-4b50-8b33-ec86a745a45d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:15 user nova-compute[75285]: INFO nova.compute.manager [req-0ab01630-525f-4f54-8a57-9accd9dee5c5 req-622bcace-a254-455d-92c7-fb80584dfc3a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Neutron deleted interface e19633a5-3e53-4b50-8b33-ec86a745a45d; detaching it from the instance and deleting it from the info cache
Nov 10 21:12:15 user nova-compute[75285]: DEBUG nova.network.neutron [req-0ab01630-525f-4f54-8a57-9accd9dee5c5 req-622bcace-a254-455d-92c7-fb80584dfc3a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [{"id": "a4ec5316-300f-4095-b774-485c613db4d9", "address": "fa:16:3e:ae:bb:98", "network": {"id": "fe43178e-f9ea-4eb5-ae15-475ddd073359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562639401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec5316-30", "ovs_interfaceid": "a4ec5316-300f-4095-b774-485c613db4d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "address": "fa:16:3e:9b:ac:12", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3496e5b6-03", "ovs_interfaceid": "3496e5b6-03c7-4c7b-9a71-932ed44c1b5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-0ab01630-525f-4f54-8a57-9accd9dee5c5 req-622bcace-a254-455d-92c7-fb80584dfc3a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Detach interface failed, port_id=e19633a5-3e53-4b50-8b33-ec86a745a45d, reason: Instance 26bec53a-de52-4a18-b778-8f917cace2dd could not be found. {{(pid=75285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 21:12:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-0ab01630-525f-4f54-8a57-9accd9dee5c5 req-622bcace-a254-455d-92c7-fb80584dfc3a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-deleted-3496e5b6-03c7-4c7b-9a71-932ed44c1b5e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:15 user nova-compute[75285]: INFO nova.compute.manager [req-0ab01630-525f-4f54-8a57-9accd9dee5c5 req-622bcace-a254-455d-92c7-fb80584dfc3a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Neutron deleted interface 3496e5b6-03c7-4c7b-9a71-932ed44c1b5e; detaching it from the instance and deleting it from the info cache
Nov 10 21:12:15 user nova-compute[75285]: DEBUG nova.network.neutron [req-0ab01630-525f-4f54-8a57-9accd9dee5c5 req-622bcace-a254-455d-92c7-fb80584dfc3a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [{"id": "a4ec5316-300f-4095-b774-485c613db4d9", "address": "fa:16:3e:ae:bb:98", "network": {"id": "fe43178e-f9ea-4eb5-ae15-475ddd073359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-562639401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ec5316-30", "ovs_interfaceid": "a4ec5316-300f-4095-b774-485c613db4d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:15 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-0ab01630-525f-4f54-8a57-9accd9dee5c5 req-622bcace-a254-455d-92c7-fb80584dfc3a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Detach interface failed, port_id=3496e5b6-03c7-4c7b-9a71-932ed44c1b5e, reason: Instance 26bec53a-de52-4a18-b778-8f917cace2dd could not be found. {{(pid=75285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 21:12:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-0ab01630-525f-4f54-8a57-9accd9dee5c5 req-622bcace-a254-455d-92c7-fb80584dfc3a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-deleted-a4ec5316-300f-4095-b774-485c613db4d9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:15 user nova-compute[75285]: INFO nova.compute.manager [req-0ab01630-525f-4f54-8a57-9accd9dee5c5 req-622bcace-a254-455d-92c7-fb80584dfc3a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Neutron deleted interface a4ec5316-300f-4095-b774-485c613db4d9; detaching it from the instance and deleting it from the info cache
Nov 10 21:12:15 user nova-compute[75285]: DEBUG nova.network.neutron [req-0ab01630-525f-4f54-8a57-9accd9dee5c5 req-622bcace-a254-455d-92c7-fb80584dfc3a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [{"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "address": "fa:16:3e:01:bf:eb", "network": {"id": "f1c2109f-a578-4e2a-86ae-7b6451db9280", "bridge": "br-int", "label": "tempest-device-tagging-net2-1792224746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2b2398-97", "ovs_interfaceid": "bd2b2398-97ca-4072-b5d8-905d2011fd16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:15 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Took 4.26 seconds to deallocate network for instance.
Nov 10 21:12:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-0ab01630-525f-4f54-8a57-9accd9dee5c5 req-622bcace-a254-455d-92c7-fb80584dfc3a service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Detach interface failed, port_id=a4ec5316-300f-4095-b774-485c613db4d9, reason: Instance 26bec53a-de52-4a18-b778-8f917cace2dd could not be found. {{(pid=75285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 21:12:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-fc762787-a66c-483c-8865-552bac54d90b req-a59d7bbb-1eb9-43b5-bfdc-78a810f33ce8 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Received event network-vif-deleted-bd2b2398-97ca-4072-b5d8-905d2011fd16 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:17 user nova-compute[75285]: INFO nova.compute.manager [req-fc762787-a66c-483c-8865-552bac54d90b req-a59d7bbb-1eb9-43b5-bfdc-78a810f33ce8 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Neutron deleted interface bd2b2398-97ca-4072-b5d8-905d2011fd16; detaching it from the instance and deleting it from the info cache
Nov 10 21:12:17 user nova-compute[75285]: DEBUG nova.network.neutron [req-fc762787-a66c-483c-8865-552bac54d90b req-a59d7bbb-1eb9-43b5-bfdc-78a810f33ce8 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Updating instance_info_cache with network_info: [{"id": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "address": "fa:16:3e:6f:75:63", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4174d5-1b", "ovs_interfaceid": "2d4174d5-1be7-4753-a29c-a3ed22b4af19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72df5ae8-22f3-4870-993a-19137df8e682", "address": "fa:16:3e:4a:11:6a", "network": {"id": "417a034c-d7ae-4ed8-b8af-5718bd7f8e86", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440826625", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "415f8f5d956148b7ad22cd31c04ceb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72df5ae8-22", "ovs_interfaceid": "72df5ae8-22f3-4870-993a-19137df8e682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-fc762787-a66c-483c-8865-552bac54d90b req-a59d7bbb-1eb9-43b5-bfdc-78a810f33ce8 service nova] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Detach interface failed, port_id=bd2b2398-97ca-4072-b5d8-905d2011fd16, reason: Instance 26bec53a-de52-4a18-b778-8f917cace2dd could not be found. {{(pid=75285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 21:12:18 user nova-compute[75285]: INFO nova.compute.manager [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] [instance: 26bec53a-de52-4a18-b778-8f917cace2dd] Took 3.40 seconds to detach 3 volumes for instance.
Nov 10 21:12:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:18 user nova-compute[75285]: ERROR nova.volume.cinder [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Update attachment failed for attachment 9ffdb594-94a7-4ef6-bf34-ce094fb09754. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c5a1df28-c9c4-433f-ae3c-afc0d303f5cf) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c5a1df28-c9c4-433f-ae3c-afc0d303f5cf)
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c5a1df28-c9c4-433f-ae3c-afc0d303f5cf)
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Traceback (most recent call last):
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     driver_block_device.attach_block_devices(
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     _log_and_attach(device)
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     self._do_attach(context, instance, volume, volume_api,
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     self._volume_attach(context, volume, connector, instance,
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     connection_info = volume_api.attachment_update(
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     res = method(self, ctx, *args, **kwargs)
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     with excutils.save_and_reraise_exception():
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     self.force_reraise()
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     raise self.value
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     return method.func(obj, *args, **kwargs)
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     resp = self._update('/attachments/%s' % id, body)
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     return self.request(url, method, **kwargs)
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39]     raise exceptions.from_response(resp, body)
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c5a1df28-c9c4-433f-ae3c-afc0d303f5cf)
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] 
Nov 10 21:12:19 user nova-compute[75285]: DEBUG nova.compute.claims [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Aborting claim: <nova.compute.claims.Claim object at 0x7f49e45b8f70> {{(pid=75285) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.175s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:19 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Deleted allocations for instance 26bec53a-de52-4a18-b778-8f917cace2dd
Nov 10 21:12:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-56e6c18b-8bc7-4657-b38e-9e4f91b45c5f tempest-TaggedBootDevicesTest-529276018 tempest-TaggedBootDevicesTest-529276018-project-member] Lock "26bec53a-de52-4a18-b778-8f917cace2dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.360s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.468s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Build of instance 6a8d254b-f470-4a0c-8d16-df8ff30e1d39 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c5a1df28-c9c4-433f-ae3c-afc0d303f5cf) {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG nova.compute.utils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Build of instance 6a8d254b-f470-4a0c-8d16-df8ff30e1d39 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75285) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 10 21:12:19 user nova-compute[75285]: ERROR nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Build of instance 6a8d254b-f470-4a0c-8d16-df8ff30e1d39 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c5a1df28-c9c4-433f-ae3c-afc0d303f5cf): nova.exception.BuildAbortException: Build of instance 6a8d254b-f470-4a0c-8d16-df8ff30e1d39 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c5a1df28-c9c4-433f-ae3c-afc0d303f5cf)
Nov 10 21:12:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Unplugging VIFs for instance {{(pid=75285) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:11:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-133171814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-133171814',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXyZtJHTP8HA+zlgHBI9VgD9RHUukUG3stJ6ddFfTKk+nEIUrbKwWKz6RfeFSNRAIkkROInkiEHG4NSh9GmPUouxL3+wO3z95BrDP9u22dopDWSBl3oyaYINU+WHFaXvA==',key_name='tempest-keypair-177752243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa149f33ca7141d4bd735f13e3eb79cd',ramdisk_id='',reservation_id='r-h00lqmg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1255002273',owner_user_name='tempest-ServerActionsV293TestJSON-1255002273-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:11:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dc83a1bc4614297a6cafe9fe2266893',uuid=6a8d254b-f470-4a0c-8d16-df8ff30e1d39,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46c104b1-45c2-4fd8-adee-18f5cd4c48eb", "address": "fa:16:3e:1a:cc:2f", "network": {"id": "d3af639d-0cde-4782-8a2c-6cc4e986069d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2057847283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa149f33ca7141d4bd735f13e3eb79cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c104b1-45", "ovs_interfaceid": "46c104b1-45c2-4fd8-adee-18f5cd4c48eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Converting VIF {"id": "46c104b1-45c2-4fd8-adee-18f5cd4c48eb", "address": "fa:16:3e:1a:cc:2f", "network": {"id": "d3af639d-0cde-4782-8a2c-6cc4e986069d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2057847283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa149f33ca7141d4bd735f13e3eb79cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c104b1-45", "ovs_interfaceid": "46c104b1-45c2-4fd8-adee-18f5cd4c48eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:cc:2f,bridge_name='br-int',has_traffic_filtering=True,id=46c104b1-45c2-4fd8-adee-18f5cd4c48eb,network=Network(d3af639d-0cde-4782-8a2c-6cc4e986069d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c104b1-45') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG os_vif [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:cc:2f,bridge_name='br-int',has_traffic_filtering=True,id=46c104b1-45c2-4fd8-adee-18f5cd4c48eb,network=Network(d3af639d-0cde-4782-8a2c-6cc4e986069d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c104b1-45') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46c104b1-45, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:12:19 user nova-compute[75285]: INFO os_vif [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:cc:2f,bridge_name='br-int',has_traffic_filtering=True,id=46c104b1-45c2-4fd8-adee-18f5cd4c48eb,network=Network(d3af639d-0cde-4782-8a2c-6cc4e986069d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c104b1-45')
Nov 10 21:12:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Unplugged VIFs for instance {{(pid=75285) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:12:19 user nova-compute[75285]: DEBUG nova.network.neutron [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:12:20 user nova-compute[75285]: DEBUG nova.network.neutron [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:20 user nova-compute[75285]: INFO nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Took 1.04 seconds to deallocate network for instance.
Nov 10 21:12:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Detaching volume: 617b4db6-30c6-4e9f-b3e8-99f70cb12778 {{(pid=75285) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 21:12:20 user nova-compute[75285]: INFO nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Detaching volume 617b4db6-30c6-4e9f-b3e8-99f70cb12778
Nov 10 21:12:20 user nova-compute[75285]: ERROR nova.virt.block_device [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Unable to call for a driver detach of volume 617b4db6-30c6-4e9f-b3e8-99f70cb12778 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance 6a8d254b-f470-4a0c-8d16-df8ff30e1d39 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c5a1df28-c9c4-433f-ae3c-afc0d303f5cf)
Nov 10 21:12:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] [instance: 6a8d254b-f470-4a0c-8d16-df8ff30e1d39] Deleting volume: 617b4db6-30c6-4e9f-b3e8-99f70cb12778 {{(pid=75285) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 21:12:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:21 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Deleted allocations for instance 6a8d254b-f470-4a0c-8d16-df8ff30e1d39
Nov 10 21:12:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64dac1ee-221a-42cb-9b52-1113d0759737 tempest-ServerActionsV293TestJSON-1255002273 tempest-ServerActionsV293TestJSON-1255002273-project-member] Lock "6a8d254b-f470-4a0c-8d16-df8ff30e1d39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.029s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "d5af6ded-e122-4121-9475-16390f19fc1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "d5af6ded-e122-4121-9475-16390f19fc1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:33 user nova-compute[75285]: DEBUG nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:12:34 user nova-compute[75285]: INFO nova.compute.claims [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Claim successful on node user
Nov 10 21:12:34 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG nova.network.neutron [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:12:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:12:34 user nova-compute[75285]: DEBUG nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG nova.policy [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e16c471c0875416aa0eb86d89eef3a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04636b8a9e404d40a3a2bc9f63a4df8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:12:34 user nova-compute[75285]: INFO nova.virt.block_device [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Booting with volume 31a1a6cc-867c-4bf0-bccf-d01937e5ee89 at /dev/vda
Nov 10 21:12:34 user nova-compute[75285]: DEBUG os_brick.utils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d576d59c-c0c1-42ce-90c4-043c1e820813]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ffb65d-3db9-411b-8f3b-9fc54c1c6926]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a1acda-e168-4703-847f-633c279bd46b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6c215d-fc5a-4eac-9c1e-09961906e84f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:12:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:12:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:12:35 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:12:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e1de1f-4b0b-4c1a-81aa-138301c7b02f]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:12:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:12:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:12:35 user nova-compute[75285]: DEBUG os_brick.utils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:12:35 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Updating existing volume attachment record: 37c17ba5-812a-485a-b5b2-7492339dc557 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:12:35 user nova-compute[75285]: DEBUG nova.network.neutron [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Successfully created port: 21fa9670-663f-472e-80ab-2fce4d3e1b79 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:12:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:36 user nova-compute[75285]: DEBUG nova.network.neutron [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Successfully updated port: 21fa9670-663f-472e-80ab-2fce4d3e1b79 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:12:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "refresh_cache-d5af6ded-e122-4121-9475-16390f19fc1e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:12:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquired lock "refresh_cache-d5af6ded-e122-4121-9475-16390f19fc1e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:12:36 user nova-compute[75285]: DEBUG nova.network.neutron [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:12:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-f04d8df0-e3eb-43dd-b698-2d558ba60ff9 req-cfdc8df4-3285-4625-9bda-8cf19729b254 service nova] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Received event network-changed-21fa9670-663f-472e-80ab-2fce4d3e1b79 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-f04d8df0-e3eb-43dd-b698-2d558ba60ff9 req-cfdc8df4-3285-4625-9bda-8cf19729b254 service nova] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Refreshing instance network info cache due to event network-changed-21fa9670-663f-472e-80ab-2fce4d3e1b79. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:12:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f04d8df0-e3eb-43dd-b698-2d558ba60ff9 req-cfdc8df4-3285-4625-9bda-8cf19729b254 service nova] Acquiring lock "refresh_cache-d5af6ded-e122-4121-9475-16390f19fc1e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:12:36 user nova-compute[75285]: DEBUG nova.network.neutron [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:12:36 user nova-compute[75285]: DEBUG nova.network.neutron [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Updating instance_info_cache with network_info: [{"id": "21fa9670-663f-472e-80ab-2fce4d3e1b79", "address": "fa:16:3e:70:19:58", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21fa9670-66", "ovs_interfaceid": "21fa9670-663f-472e-80ab-2fce4d3e1b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Releasing lock "refresh_cache-d5af6ded-e122-4121-9475-16390f19fc1e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:12:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Instance network_info: |[{"id": "21fa9670-663f-472e-80ab-2fce4d3e1b79", "address": "fa:16:3e:70:19:58", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21fa9670-66", "ovs_interfaceid": "21fa9670-663f-472e-80ab-2fce4d3e1b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:12:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f04d8df0-e3eb-43dd-b698-2d558ba60ff9 req-cfdc8df4-3285-4625-9bda-8cf19729b254 service nova] Acquired lock "refresh_cache-d5af6ded-e122-4121-9475-16390f19fc1e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:12:37 user nova-compute[75285]: DEBUG nova.network.neutron [req-f04d8df0-e3eb-43dd-b698-2d558ba60ff9 req-cfdc8df4-3285-4625-9bda-8cf19729b254 service nova] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Refreshing network info cache for port 21fa9670-663f-472e-80ab-2fce4d3e1b79 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:12:37 user nova-compute[75285]: DEBUG nova.network.neutron [req-f04d8df0-e3eb-43dd-b698-2d558ba60ff9 req-cfdc8df4-3285-4625-9bda-8cf19729b254 service nova] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Updated VIF entry in instance network info cache for port 21fa9670-663f-472e-80ab-2fce4d3e1b79. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:12:37 user nova-compute[75285]: DEBUG nova.network.neutron [req-f04d8df0-e3eb-43dd-b698-2d558ba60ff9 req-cfdc8df4-3285-4625-9bda-8cf19729b254 service nova] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Updating instance_info_cache with network_info: [{"id": "21fa9670-663f-472e-80ab-2fce4d3e1b79", "address": "fa:16:3e:70:19:58", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21fa9670-66", "ovs_interfaceid": "21fa9670-663f-472e-80ab-2fce4d3e1b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f04d8df0-e3eb-43dd-b698-2d558ba60ff9 req-cfdc8df4-3285-4625-9bda-8cf19729b254 service nova] Releasing lock "refresh_cache-d5af6ded-e122-4121-9475-16390f19fc1e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:12:37 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:12:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:40 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:12:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:41 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:12:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:12:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:12:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:12:41 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:12:42 user nova-compute[75285]: INFO nova.compute.claims [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Claim successful on node user
Nov 10 21:12:42 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Updating instance_info_cache with network_info: [{"id": "e351ba01-6d16-40ea-ae88-097b9756cc70", "address": "fa:16:3e:a6:48:80", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape351ba01-6d", "ovs_interfaceid": "e351ba01-6d16-40ea-ae88-097b9756cc70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG nova.network.neutron [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:12:42 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:12:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:12:42 user nova-compute[75285]: DEBUG nova.policy [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac13c724170f47368e5a395110c631b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9957f55c59044088e94338564e04092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:12:42 user nova-compute[75285]: INFO nova.virt.block_device [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Booting with blank volume at /dev/vda
Nov 10 21:12:43 user nova-compute[75285]: DEBUG nova.network.neutron [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Successfully created port: 0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:12:43 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:12:43 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:12:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:43 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:12:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG nova.network.neutron [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Successfully updated port: 0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquired lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG nova.network.neutron [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG nova.compute.manager [req-e913f48c-c481-49d9-85bf-19454adadc05 req-b51d26de-d222-4752-996e-37577fc048ba service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-changed-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG nova.compute.manager [req-e913f48c-c481-49d9-85bf-19454adadc05 req-b51d26de-d222-4752-996e-37577fc048ba service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Refreshing instance network info cache due to event network-changed-0e6fef20-7528-4441-9e5d-6d81d4fd10a3. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e913f48c-c481-49d9-85bf-19454adadc05 req-b51d26de-d222-4752-996e-37577fc048ba service nova] Acquiring lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG nova.network.neutron [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG nova.network.neutron [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Updating instance_info_cache with network_info: [{"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Releasing lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Instance network_info: |[{"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e913f48c-c481-49d9-85bf-19454adadc05 req-b51d26de-d222-4752-996e-37577fc048ba service nova] Acquired lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:12:44 user nova-compute[75285]: DEBUG nova.network.neutron [req-e913f48c-c481-49d9-85bf-19454adadc05 req-b51d26de-d222-4752-996e-37577fc048ba service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Refreshing network info cache for port 0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG nova.network.neutron [req-e913f48c-c481-49d9-85bf-19454adadc05 req-b51d26de-d222-4752-996e-37577fc048ba service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Updated VIF entry in instance network info cache for port 0e6fef20-7528-4441-9e5d-6d81d4fd10a3. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG nova.network.neutron [req-e913f48c-c481-49d9-85bf-19454adadc05 req-b51d26de-d222-4752-996e-37577fc048ba service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Updating instance_info_cache with network_info: [{"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e913f48c-c481-49d9-85bf-19454adadc05 req-b51d26de-d222-4752-996e-37577fc048ba service nova] Releasing lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:48 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:12:48 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7598MB free_disk=25.23278045654297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 09ab2e54-1189-420e-9e5c-d158e4106ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3a0c67ef-1414-47e0-8769-c9164baf8993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 0ad7b009-e56f-48ae-8643-29abadf283a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 72a39007-63f0-4f1b-8689-286c55ea1d0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 073785c4-a92c-4297-ab62-55c31b424ffc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance d5af6ded-e122-4121-9475-16390f19fc1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:12:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.660s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:49 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:12:49 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:12:49 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:12:49 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG nova.objects.instance [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lazy-loading 'flavor' on Instance uuid 09ab2e54-1189-420e-9e5c-d158e4106ffd {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:12:50 user nova-compute[75285]: INFO nova.compute.manager [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Attaching volume 822836c3-ad6b-4714-a890-5dfb85ba0b19 to /dev/vdb
Nov 10 21:12:50 user nova-compute[75285]: DEBUG os_brick.utils [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae29bdd6-134f-4226-83fb-3bb50795efd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73eaf6d-ec80-4c38-b7d6-9e27aad10957]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3eed1e-1942-470c-a74e-ec86ec7159b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a041b90-2823-46a6-b864-0e2403768f59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:12:50 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:12:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[21929f28-2efc-4dee-af26-2277137d09f9]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG os_brick.utils [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:12:50 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updating existing volume attachment record: 423ec278-ec05-4769-9ceb-9d6abf03d814 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG os_brick.utils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d2ebe-8277-4293-a195-e6b9882e3043]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e9a39a-5365-41e3-aff1-0e9ae19359c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[390bfac5-ff41-4815-8265-702b6f0c8ed5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e9095f-183b-45cf-92c7-ffeb33564f2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:12:53 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:12:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8ad36b-e964-4cf8-8736-90240e144d73]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG os_brick.utils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:12:53 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Updating existing volume attachment record: c5dc060a-e8ca-4c81-958e-a1dc40bf2c0b {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:12:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:12:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.volume.cinder [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Update attachment failed for attachment 37c17ba5-812a-485a-b5b2-7492339dc557. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4dd4fd26-88ea-42fa-8d53-ceb48cd87538) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4dd4fd26-88ea-42fa-8d53-ceb48cd87538)
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4dd4fd26-88ea-42fa-8d53-ceb48cd87538)
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Traceback (most recent call last):
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     driver_block_device.attach_block_devices(
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     _log_and_attach(device)
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     self._do_attach(context, instance, volume, volume_api,
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     self._volume_attach(context, volume, connector, instance,
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     connection_info = volume_api.attachment_update(
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     res = method(self, ctx, *args, **kwargs)
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     with excutils.save_and_reraise_exception():
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     self.force_reraise()
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     raise self.value
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     return method.func(obj, *args, **kwargs)
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     resp = self._update('/attachments/%s' % id, body)
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     return self.request(url, method, **kwargs)
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e]     raise exceptions.from_response(resp, body)
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4dd4fd26-88ea-42fa-8d53-ceb48cd87538)
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [instance: d5af6ded-e122-4121-9475-16390f19fc1e] 
Nov 10 21:13:01 user nova-compute[75285]: DEBUG nova.compute.claims [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Aborting claim: <nova.compute.claims.Claim object at 0x7f49e4413df0> {{(pid=75285) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.505s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Build of instance d5af6ded-e122-4121-9475-16390f19fc1e aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4dd4fd26-88ea-42fa-8d53-ceb48cd87538) {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG nova.compute.utils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Build of instance d5af6ded-e122-4121-9475-16390f19fc1e aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75285) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 10 21:13:01 user nova-compute[75285]: ERROR nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Build of instance d5af6ded-e122-4121-9475-16390f19fc1e aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4dd4fd26-88ea-42fa-8d53-ceb48cd87538): nova.exception.BuildAbortException: Build of instance d5af6ded-e122-4121-9475-16390f19fc1e aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4dd4fd26-88ea-42fa-8d53-ceb48cd87538)
Nov 10 21:13:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Unplugging VIFs for instance {{(pid=75285) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1138311189',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1138311189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1138311189',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHe7dtcvijOhKZunjrFIq4qxrwX4qcrbXdky14oo15lUClxe3n4JSI8jXMXKUNSxjfNOk7KhM7FKZF2nsDuBE1oLMAPFiLyX3zj+kE13LAq6WGZ9R9jfRlMoFblBjQlSPw==',key_name='tempest-keypair-136633986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04636b8a9e404d40a3a2bc9f63a4df8c',ramdisk_id='',reservation_id='r-82keya6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1962512242',owner_user_name='tempest-TestVolumeBootPattern-1962512242-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:12:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e16c471c0875416aa0eb86d89eef3a27',uuid=d5af6ded-e122-4121-9475-16390f19fc1e,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21fa9670-663f-472e-80ab-2fce4d3e1b79", "address": "fa:16:3e:70:19:58", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21fa9670-66", "ovs_interfaceid": "21fa9670-663f-472e-80ab-2fce4d3e1b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converting VIF {"id": "21fa9670-663f-472e-80ab-2fce4d3e1b79", "address": "fa:16:3e:70:19:58", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21fa9670-66", "ovs_interfaceid": "21fa9670-663f-472e-80ab-2fce4d3e1b79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:19:58,bridge_name='br-int',has_traffic_filtering=True,id=21fa9670-663f-472e-80ab-2fce4d3e1b79,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21fa9670-66') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG os_vif [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:19:58,bridge_name='br-int',has_traffic_filtering=True,id=21fa9670-663f-472e-80ab-2fce4d3e1b79,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21fa9670-66') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21fa9670-66, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:13:01 user nova-compute[75285]: INFO os_vif [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:19:58,bridge_name='br-int',has_traffic_filtering=True,id=21fa9670-663f-472e-80ab-2fce4d3e1b79,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21fa9670-66')
Nov 10 21:13:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Unplugged VIFs for instance {{(pid=75285) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:13:01 user nova-compute[75285]: DEBUG nova.network.neutron [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:13:02 user nova-compute[75285]: DEBUG nova.network.neutron [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:13:02 user nova-compute[75285]: INFO nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Took 0.79 seconds to deallocate network for instance.
Nov 10 21:13:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Detaching volume: 31a1a6cc-867c-4bf0-bccf-d01937e5ee89 {{(pid=75285) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 21:13:02 user nova-compute[75285]: INFO nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Detaching volume 31a1a6cc-867c-4bf0-bccf-d01937e5ee89
Nov 10 21:13:02 user nova-compute[75285]: ERROR nova.virt.block_device [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Unable to call for a driver detach of volume 31a1a6cc-867c-4bf0-bccf-d01937e5ee89 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance d5af6ded-e122-4121-9475-16390f19fc1e aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4dd4fd26-88ea-42fa-8d53-ceb48cd87538)
Nov 10 21:13:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: d5af6ded-e122-4121-9475-16390f19fc1e] Deleting volume: 31a1a6cc-867c-4bf0-bccf-d01937e5ee89 {{(pid=75285) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 21:13:03 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Deleted allocations for instance d5af6ded-e122-4121-9475-16390f19fc1e
Nov 10 21:13:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e23ae86d-b765-4c55-b5ad-e6c352b0eaa2 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "d5af6ded-e122-4121-9475-16390f19fc1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.166s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 2941-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:13:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCWcAdSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:13:18 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:13:18 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:13:18 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0625d906-d706-44f8-80a0-846636a1199a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:13:18 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc43826-7c72-488f-bbd5-c58a93fa215e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19] added
Nov 10 21:13:18 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba39acf-5e80-49b9-acd9-ac8c259a8ae6]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee317f4e-3836-4016-9f24-c63ad1effb8b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LCWcAdSm {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LCWcAdSm" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[265b73ef-e3e5-41ad-a706-2ab7dd88bc7a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LCWcAdSm'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d74864e-f140-4080-8efd-000ce1df7831]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6140ef0-a034-4e1f-b5f2-13a08d801304]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:13:18 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:13:18 user nova-compute[75285]:  {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:13:18 user nova-compute[75285]: WARNING os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 21:13:18 user nova-compute[75285]: 
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f982835-929e-4653-9856-97af30c0f99e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19, portal: 172.16.0.220,3260]
Nov 10 21:13:18 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19, portal: 172.16.0.220,3260] successful.
Nov 10 21:13:18 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[287be1cb-3c89-4d37-81f9-1d89eb2f188c]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[436a3bfe-9989-4c10-851e-61e780db1b6d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:13:18 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:13:18 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe7a7c4-2f50-426a-bd69-2ac4f42f04b4]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:13:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCWcAdSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:13:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:13:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23634363163653539', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:13:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634363163653539', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:13:19 user nova-compute[75285]: DEBUG nova.objects.instance [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lazy-loading 'flavor' on Instance uuid 09ab2e54-1189-420e-9e5c-d158e4106ffd {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:13:19 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:13:19 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:13:19 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:13:19 user nova-compute[75285]:   <serial>822836c3-ad6b-4714-a890-5dfb85ba0b19</serial>
Nov 10 21:13:19 user nova-compute[75285]: </disk>
Nov 10 21:13:19 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:13:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:13:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:13:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] No VIF found with MAC fa:16:3e:98:9a:13, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-37f64593-b765-4dd8-a7de-ee2457eea6ff tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.647s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.compute.manager [req-087eaed1-a006-4486-af53-3a6ae1ededfe req-917d01b8-b10d-4c22-ab3f-d86c9e5d9010 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-changed-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.compute.manager [req-087eaed1-a006-4486-af53-3a6ae1ededfe req-917d01b8-b10d-4c22-ab3f-d86c9e5d9010 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Refreshing instance network info cache due to event network-changed-ea61ffb9-f415-4c97-850b-56d25719be25. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-087eaed1-a006-4486-af53-3a6ae1ededfe req-917d01b8-b10d-4c22-ab3f-d86c9e5d9010 service nova] Acquiring lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-087eaed1-a006-4486-af53-3a6ae1ededfe req-917d01b8-b10d-4c22-ab3f-d86c9e5d9010 service nova] Acquired lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.network.neutron [req-087eaed1-a006-4486-af53-3a6ae1ededfe req-917d01b8-b10d-4c22-ab3f-d86c9e5d9010 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Refreshing network info cache for port ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.objects.instance [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'flavor' on Instance uuid 0ad7b009-e56f-48ae-8643-29abadf283a4 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:20 user nova-compute[75285]: INFO nova.compute.manager [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Attaching volume e333f9e0-5446-4abf-8485-6f02b10ae437 to /dev/vdb
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.utils [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acb2b67-95cd-41c6-9cfc-499fc1dd8794]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[629fc95f-184e-41a0-a773-376b1a2d12b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e997a6d-2982-4c25-99a3-4dbf342fac8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1965dd14-d590-4b6a-9ea4-04816af2ad26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:13:20 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Creating image(s)
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Did not create local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Ensure instance console log exists: /opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Start _get_guest_xml network_info=[{"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'c5dc060a-e8ca-4c81-958e-a1dc40bf2c0b', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmHUkxpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ac0ddf13-9584-4e5d-99be-ad8feb6c532f', 'attached_at': '', 'detached_at': '', 'volume_id': '8ad68515-50bc-444d-adf3-8552e9192868', 'serial': '8ad68515-50bc-444d-adf3-8552e9192868'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:13:20 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a033be-e028-41e7-86bd-5b900210b686]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.utils [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Updating existing volume attachment record: 2c3482ba-d270-4c35-940c-ee94f9b25363 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:13:20 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:13:20 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmHUkxpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:13:20 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:13:20 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:13:20 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.network.neutron [req-087eaed1-a006-4486-af53-3a6ae1ededfe req-917d01b8-b10d-4c22-ab3f-d86c9e5d9010 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Updated VIF entry in instance network info cache for port ea61ffb9-f415-4c97-850b-56d25719be25. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG nova.network.neutron [req-087eaed1-a006-4486-af53-3a6ae1ededfe req-917d01b8-b10d-4c22-ab3f-d86c9e5d9010 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Updating instance_info_cache with network_info: [{"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc66589a-ec90-4c5c-8d8a-8984502cdee8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:13:20 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-087eaed1-a006-4486-af53-3a6ae1ededfe req-917d01b8-b10d-4c22-ab3f-d86c9e5d9010 service nova] Releasing lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a75a5e-6b76-4449-8ed6-e8a688713412]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868] added
Nov 10 21:13:20 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c749e9cc-1bad-496b-95b3-a8885840d9b5]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5770d6b7-41eb-4fa3-b64c-48f78c1d6cf4]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmHUkxpu {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmHUkxpu" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3681a7-23e3-40ae-97fd-ef5996fd03db]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OmHUkxpu'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec1ee1a-0b3b-4fd9-aba2-6a9295c6f7d1]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c520a33-7e69-4f09-b608-1ef404b23073]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:13:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:13:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[746ad88e-2ca1-4278-a133-fe757a1cfc17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868, portal: 172.16.0.220,3260]
Nov 10 21:13:21 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868, portal: 172.16.0.220,3260] successful.
Nov 10 21:13:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafdd04f-9a06-4dd4-874c-df9dd2f7151f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48eab89-b257-4cb2-a930-654f675d6975]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:13:21 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:13:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:13:21 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:13:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:21 user nova-compute[75285]: INFO nova.compute.manager [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Rescuing
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquired lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG nova.network.neutron [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.132s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdffce6-f7e1-49b6-bfbc-115d655a470e]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG nova.network.neutron [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updating instance_info_cache with network_info: [{"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:13:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Releasing lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmHUkxpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '26161633366663564', 'path': '/dev/sdc'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161633366663564', 'path': '/dev/sdc'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1163902995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1163902995',id=24,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9957f55c59044088e94338564e04092',ramdisk_id='',reservation_id='r-5x066zft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-396261753',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:12:43Z,user_data=None,user_id='ac13c724170f47368e5a395110c631b7',uuid=ac0ddf13-9584-4e5d-99be-ad8feb6c532f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converting VIF {"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:a1:72,bridge_name='br-int',has_traffic_filtering=True,id=0e6fef20-7528-4441-9e5d-6d81d4fd10a3,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6fef20-75') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG nova.objects.instance [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'pci_devices' on Instance uuid ac0ddf13-9584-4e5d-99be-ad8feb6c532f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-1a22df49-bd33-4cc3-87a0-38bfc0d6acbe req-ee5b8960-f65e-40b7-a89d-2269119f2680 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1a22df49-bd33-4cc3-87a0-38bfc0d6acbe req-ee5b8960-f65e-40b7-a89d-2269119f2680 service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1a22df49-bd33-4cc3-87a0-38bfc0d6acbe req-ee5b8960-f65e-40b7-a89d-2269119f2680 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1a22df49-bd33-4cc3-87a0-38bfc0d6acbe req-ee5b8960-f65e-40b7-a89d-2269119f2680 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-1a22df49-bd33-4cc3-87a0-38bfc0d6acbe req-ee5b8960-f65e-40b7-a89d-2269119f2680 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:22 user nova-compute[75285]: WARNING nova.compute.manager [req-1a22df49-bd33-4cc3-87a0-38bfc0d6acbe req-ee5b8960-f65e-40b7-a89d-2269119f2680 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state active and task_state rescuing.
Nov 10 21:13:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:13:22 user nova-compute[75285]:   <uuid>ac0ddf13-9584-4e5d-99be-ad8feb6c532f</uuid>
Nov 10 21:13:22 user nova-compute[75285]:   <name>instance-00000018</name>
Nov 10 21:13:22 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:13:22 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:13:22 user nova-compute[75285]:   <metadata>
Nov 10 21:13:22 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:13:22 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:13:22 user nova-compute[75285]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1163902995</nova:name>
Nov 10 21:13:22 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:13:20</nova:creationTime>
Nov 10 21:13:22 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:13:22 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:13:22 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:13:22 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:13:22 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:13:22 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:13:22 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:13:22 user nova-compute[75285]:       <nova:owner>
Nov 10 21:13:22 user nova-compute[75285]:         <nova:user uuid="ac13c724170f47368e5a395110c631b7">tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member</nova:user>
Nov 10 21:13:22 user nova-compute[75285]:         <nova:project uuid="b9957f55c59044088e94338564e04092">tempest-ServerBootFromVolumeStableRescueTest-396261753</nova:project>
Nov 10 21:13:22 user nova-compute[75285]:       </nova:owner>
Nov 10 21:13:22 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:13:22 user nova-compute[75285]:       <nova:ports>
Nov 10 21:13:22 user nova-compute[75285]:         <nova:port uuid="0e6fef20-7528-4441-9e5d-6d81d4fd10a3">
Nov 10 21:13:22 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 21:13:22 user nova-compute[75285]:         </nova:port>
Nov 10 21:13:22 user nova-compute[75285]:       </nova:ports>
Nov 10 21:13:22 user nova-compute[75285]:     </nova:instance>
Nov 10 21:13:22 user nova-compute[75285]:   </metadata>
Nov 10 21:13:22 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:13:22 user nova-compute[75285]:     <system>
Nov 10 21:13:22 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:13:22 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:13:22 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:13:22 user nova-compute[75285]:       <entry name="serial">ac0ddf13-9584-4e5d-99be-ad8feb6c532f</entry>
Nov 10 21:13:22 user nova-compute[75285]:       <entry name="uuid">ac0ddf13-9584-4e5d-99be-ad8feb6c532f</entry>
Nov 10 21:13:22 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:13:22 user nova-compute[75285]:     </system>
Nov 10 21:13:22 user nova-compute[75285]:   </sysinfo>
Nov 10 21:13:22 user nova-compute[75285]:   <os>
Nov 10 21:13:22 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:13:22 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:13:22 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:13:22 user nova-compute[75285]:   </os>
Nov 10 21:13:22 user nova-compute[75285]:   <features>
Nov 10 21:13:22 user nova-compute[75285]:     <acpi/>
Nov 10 21:13:22 user nova-compute[75285]:     <apic/>
Nov 10 21:13:22 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:13:22 user nova-compute[75285]:   </features>
Nov 10 21:13:22 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:13:22 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:13:22 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:13:22 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:13:22 user nova-compute[75285]:   </clock>
Nov 10 21:13:22 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:13:22 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:13:22 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:13:22 user nova-compute[75285]:   </cpu>
Nov 10 21:13:22 user nova-compute[75285]:   <devices>
Nov 10 21:13:22 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:13:22 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:13:22 user nova-compute[75285]:       <source dev="/dev/sdc"/>
Nov 10 21:13:22 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:13:22 user nova-compute[75285]:       <serial>8ad68515-50bc-444d-adf3-8552e9192868</serial>
Nov 10 21:13:22 user nova-compute[75285]:     </disk>
Nov 10 21:13:22 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:13:22 user nova-compute[75285]:       <mac address="fa:16:3e:6d:a1:72"/>
Nov 10 21:13:22 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:13:22 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:13:22 user nova-compute[75285]:       <target dev="tap0e6fef20-75"/>
Nov 10 21:13:22 user nova-compute[75285]:     </interface>
Nov 10 21:13:22 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:13:22 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/console.log" append="off"/>
Nov 10 21:13:22 user nova-compute[75285]:     </serial>
Nov 10 21:13:22 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:13:22 user nova-compute[75285]:     <video>
Nov 10 21:13:22 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:13:22 user nova-compute[75285]:     </video>
Nov 10 21:13:22 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:13:22 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:13:22 user nova-compute[75285]:     </rng>
Nov 10 21:13:22 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:13:22 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:13:22 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:13:22 user nova-compute[75285]:     </memballoon>
Nov 10 21:13:22 user nova-compute[75285]:   </devices>
Nov 10 21:13:22 user nova-compute[75285]: </domain>
Nov 10 21:13:22 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1163902995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1163902995',id=24,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9957f55c59044088e94338564e04092',ramdisk_id='',reservation_id='r-5x066zft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-396261753',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:12:43Z,user_data=None,user_id='ac13c724170f47368e5a395110c631b7',uuid=ac0ddf13-9584-4e5d-99be-ad8feb6c532f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converting VIF {"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:a1:72,bridge_name='br-int',has_traffic_filtering=True,id=0e6fef20-7528-4441-9e5d-6d81d4fd10a3,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6fef20-75') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG os_vif [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:a1:72,bridge_name='br-int',has_traffic_filtering=True,id=0e6fef20-7528-4441-9e5d-6d81d4fd10a3,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6fef20-75') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4b934f9-15b0-5da2-ab29-ba7954a95d72', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e6fef20-75, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e6fef20-75, col_values=(('qos', UUID('771c6070-77e1-4ea1-9c35-d2501e2e2c31')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e6fef20-75, col_values=(('external_ids', {'iface-id': '0e6fef20-7528-4441-9e5d-6d81d4fd10a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:a1:72', 'vm-uuid': 'ac0ddf13-9584-4e5d-99be-ad8feb6c532f'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: INFO os_vif [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:a1:72,bridge_name='br-int',has_traffic_filtering=True,id=0e6fef20-7528-4441-9e5d-6d81d4fd10a3,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6fef20-75')
Nov 10 21:13:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] No VIF found with MAC fa:16:3e:6d:a1:72, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:23 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Instance destroyed successfully.
Nov 10 21:13:23 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Attempting a stable device rescue
Nov 10 21:13:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75285) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 21:13:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Instance directory exists: not creating {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 21:13:23 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Creating image(s)
Nov 10 21:13:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "/opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "/opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "/opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:23 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lazy-loading 'trusted_certs' on Instance uuid 09ab2e54-1189-420e-9e5c-d158e4106ffd {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "653e67bf97ecb810b653ebddb45ed8f2550af0a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "653e67bf97ecb810b653ebddb45ed8f2550af0a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.009s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2.part --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:25 user nova-compute[75285]: WARNING nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state active and task_state rescuing.
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:25 user nova-compute[75285]: WARNING nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state active and task_state rescuing.
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:25 user nova-compute[75285]: WARNING nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state active and task_state rescuing.
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:25 user nova-compute[75285]: WARNING nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state active and task_state rescuing.
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:25 user nova-compute[75285]: WARNING nova.compute.manager [req-66f433b6-bb25-40b9-bcc3-bc6927adc9f6 req-640f297d-4daf-4aff-afdd-7dd3d6daa576 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state active and task_state rescuing.
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-2d82f633-ed74-4162-beff-d3d361f7aecb req-f932b74a-92e7-46e9-ace5-c8956748ae42 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2d82f633-ed74-4162-beff-d3d361f7aecb req-f932b74a-92e7-46e9-ace5-c8956748ae42 service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2d82f633-ed74-4162-beff-d3d361f7aecb req-f932b74a-92e7-46e9-ace5-c8956748ae42 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2d82f633-ed74-4162-beff-d3d361f7aecb req-f932b74a-92e7-46e9-ace5-c8956748ae42 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-2d82f633-ed74-4162-beff-d3d361f7aecb req-f932b74a-92e7-46e9-ace5-c8956748ae42 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:25 user nova-compute[75285]: WARNING nova.compute.manager [req-2d82f633-ed74-4162-beff-d3d361f7aecb req-f932b74a-92e7-46e9-ace5-c8956748ae42 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state building and task_state spawning.
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2.part --force-share --output=json" returned: 0 in 0.228s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.images [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] 3c0fc687-9dae-498b-8fc4-3e21efe5897d was qcow2, converting to raw {{(pid=75285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2.part /opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2.converted {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2.part /opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2.converted" returned: 0 in 0.204s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2.converted --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "653e67bf97ecb810b653ebddb45ed8f2550af0a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.955s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "653e67bf97ecb810b653ebddb45ed8f2550af0a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "653e67bf97ecb810b653ebddb45ed8f2550af0a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2 --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2,backing_fmt=raw /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.rescue {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2,backing_fmt=raw /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.rescue" returned: 0 in 0.052s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "653e67bf97ecb810b653ebddb45ed8f2550af0a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lazy-loading 'migration_context' on Instance uuid 09ab2e54-1189-420e-9e5c-d158e4106ffd {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.objects.base [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Object Instance<09ab2e54-1189-420e-9e5c-d158e4106ffd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Start _get_guest_xml network_info=[{"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "vif_mac": "fa:16:3e:98:9a:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3c0fc687-9dae-498b-8fc4-3e21efe5897d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '423ec278-ec05-4769-9ceb-9d6abf03d814', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCWcAdSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '09ab2e54-1189-420e-9e5c-d158e4106ffd', 'attached_at': '', 'detached_at': '', 'volume_id': '822836c3-ad6b-4714-a890-5dfb85ba0b19', 'serial': '822836c3-ad6b-4714-a890-5dfb85ba0b19'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lazy-loading 'resources' on Instance uuid 09ab2e54-1189-420e-9e5c-d158e4106ffd {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.objects.base [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Object Instance<09ab2e54-1189-420e-9e5c-d158e4106ffd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lazy-loading 'numa_topology' on Instance uuid 09ab2e54-1189-420e-9e5c-d158e4106ffd {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.objects.base [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Object Instance<09ab2e54-1189-420e-9e5c-d158e4106ffd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:13:25 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:13:25 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:13:25 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lazy-loading 'vcpu_model' on Instance uuid 09ab2e54-1189-420e-9e5c-d158e4106ffd {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.objects.base [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Object Instance<09ab2e54-1189-420e-9e5c-d158e4106ffd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCWcAdSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:13:26 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:13:26 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:13:26 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d31ba0-dd2d-42e2-a1f8-f6c9f79628b0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LCWcAdSm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 21:13:26 user nova-compute[75285]: node.name = iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19
Nov 10 21:13:26 user nova-compute[75285]: node.tpgt = -1
Nov 10 21:13:26 user nova-compute[75285]: node.startup = automatic
Nov 10 21:13:26 user nova-compute[75285]: node.leading_login = No
Nov 10 21:13:26 user nova-compute[75285]: iface.iscsi_ifacename = default
Nov 10 21:13:26 user nova-compute[75285]: iface.net_ifacename = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.ipaddress = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.prefix_len = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.hwaddress = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.transport_name = tcp
Nov 10 21:13:26 user nova-compute[75285]: iface.initiatorname = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.state = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.vlan_id = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.vlan_priority = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.vlan_state = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.iface_num = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.mtu = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.port = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.bootproto = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.subnet_mask = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.gateway = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.dhcp_alt_client_id = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.dhcp_dns = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.dhcp_learn_iqn = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.dhcp_vendor_id_state = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.dhcp_vendor_id = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.dhcp_slp_da = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.fragmentation = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.gratuitous_arp = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.incoming_forwarding = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.tos_state = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.tos = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.ttl = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.delayed_ack = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.tcp_nagle = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.tcp_wsf_state = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.tcp_wsf = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.tcp_timer_scale = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.tcp_timestamp = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.redirect = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.def_task_mgmt_timeout = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.header_digest = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.data_digest = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.immediate_data = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.initial_r2t = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.data_seq_inorder = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.data_pdu_inorder = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.erl = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.max_receive_data_len = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.first_burst_len = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.max_outstanding_r2t = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.max_burst_len = 0
Nov 10 21:13:26 user nova-compute[75285]: iface.chap_auth = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.bidi_chap = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.strict_login_compliance = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.discovery_auth = <empty>
Nov 10 21:13:26 user nova-compute[75285]: iface.discovery_logout = <empty>
Nov 10 21:13:26 user nova-compute[75285]: node.discovery_address = <empty>
Nov 10 21:13:26 user nova-compute[75285]: node.discovery_port = 0
Nov 10 21:13:26 user nova-compute[75285]: node.discovery_type = static
Nov 10 21:13:26 user nova-compute[75285]: node.session.initial_cmdsn = 0
Nov 10 21:13:26 user nova-compute[75285]: node.session.initial_login_retry_max = 8
Nov 10 21:13:26 user nova-compute[75285]: node.session.xmit_thread_priority = -20
Nov 10 21:13:26 user nova-compute[75285]: node.session.cmds_max = 128
Nov 10 21:13:26 user nova-compute[75285]: node.session.queue_depth = 32
Nov 10 21:13:26 user nova-compute[75285]: node.session.nr_sessions = 1
Nov 10 21:13:26 user nova-compute[75285]: node.session.auth.authmethod = CHAP
Nov 10 21:13:26 user nova-compute[75285]: node.session.auth.username = LCWcAdSm
Nov 10 21:13:26 user nova-compute[75285]: node.session.auth.password = ***
Nov 10 21:13:26 user nova-compute[75285]: node.session.auth.username_in = <empty>
Nov 10 21:13:26 user nova-compute[75285]: node.session.auth.password_in = <empty>
Nov 10 21:13:26 user nova-compute[75285]: node.session.auth.chap_algs = MD5
Nov 10 21:13:26 user nova-compute[75285]: node.session.timeo.replacement_timeout = 120
Nov 10 21:13:26 user nova-compute[75285]: node.session.err_timeo.abort_timeout = 15
Nov 10 21:13:26 user nova-compute[75285]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 21:13:26 user nova-compute[75285]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 21:13:26 user nova-compute[75285]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 21:13:26 user nova-compute[75285]: node.session.iscsi.FastAbort = Yes
Nov 10 21:13:26 user nova-compute[75285]: node.session.iscsi.InitialR2T = No
Nov 10 21:13:26 user nova-compute[75285]: node.session.iscsi.ImmediateData = Yes
Nov 10 21:13:26 user nova-compute[75285]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 21:13:26 user nova-compute[75285]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 21:13:26 user nova-compute[75285]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 21:13:26 user nova-compute[75285]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 21:13:26 user nova-compute[75285]: node.session.iscsi.MaxConnections = 1
Nov 10 21:13:26 user nova-compute[75285]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 21:13:26 user nova-compute[75285]: node.session.iscsi.ERL = 0
Nov 10 21:13:26 user nova-compute[75285]: node.session.scan = manual
Nov 10 21:13:26 user nova-compute[75285]: node.session.reopen_max = 0
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].address = 172.16.0.220
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].port = 3260
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].startup = manual
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].tcp.window_size = 524288
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].tcp.type_of_service = 0
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].timeo.logout_timeout = 15
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].timeo.login_timeout = 15
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].timeo.auth_timeout = 45
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].iscsi.DataDigest = None
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].iscsi.IFMarker = No
Nov 10 21:13:26 user nova-compute[75285]: node.conn[0].iscsi.OFMarker = No
Nov 10 21:13:26 user nova-compute[75285]: # END RECORD
Nov 10 21:13:26 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[01769883-d37a-4a65-8685-b631a97b1802]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd336aa-e22e-46c4-a8f7-fc116f99159e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LCWcAdSm {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LCWcAdSm" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9815c8-f5d5-4187-a32b-d89aaf4366a0]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LCWcAdSm'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0e2a2f-9ceb-456a-bd58-d80f451228de]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f91f225-6d92-4568-9aea-581959668395]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:13:26 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:13:26 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:13:26 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:13:26 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.179s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] HCTL ('33', '0', '0', 0) found on session 19 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[69084fee-58b1-47ad-a9fb-1d641ef7f983]: (4, ('0 0 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Searching for a device in session 19 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCWcAdSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.212s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] <== connect_volume: return (214ms) {'type': 'block', 'scsi_wwn': '23634363163653539', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634363163653539', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:09:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-811159608',display_name='tempest-ServerStableDeviceRescueTest-server-811159608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-811159608',id=15,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU07Ee5gBfRVYMO1ihS+0v5mu4gwIvzqpIBvB/vUtCSDnxXiUb7ZTEwrZe/CpZEFTOFu4c1jqCagvop9YQAVI0CVZqSTeskkQBWLzNdLeTJXM3Pqa79j1/Ny7cbPqCWiw==',key_name='tempest-keypair-2027067703',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:09:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='159848b23a33449aa7eef3b73061912d',ramdisk_id='',reservation_id='r-0drfnm4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1367693602',owner_user_name='tempest-ServerStableDeviceRescueTest-1367693602-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8a625a7d0264f49ad3ddbbdeca81fef',uuid=09ab2e54-1189-420e-9e5c-d158e4106ffd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "vif_mac": "fa:16:3e:98:9a:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Converting VIF {"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "vif_mac": "fa:16:3e:98:9a:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:9a:13,bridge_name='br-int',has_traffic_filtering=True,id=bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef,network=Network(1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8d1ec8-27') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lazy-loading 'pci_devices' on Instance uuid 09ab2e54-1189-420e-9e5c-d158e4106ffd {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.objects.base [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Object Instance<09ab2e54-1189-420e-9e5c-d158e4106ffd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:13:26 user nova-compute[75285]:   <uuid>09ab2e54-1189-420e-9e5c-d158e4106ffd</uuid>
Nov 10 21:13:26 user nova-compute[75285]:   <name>instance-0000000f</name>
Nov 10 21:13:26 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:13:26 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:13:26 user nova-compute[75285]:   <metadata>
Nov 10 21:13:26 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:13:26 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:13:26 user nova-compute[75285]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-811159608</nova:name>
Nov 10 21:13:26 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:13:25</nova:creationTime>
Nov 10 21:13:26 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:13:26 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:13:26 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:13:26 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:13:26 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:13:26 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:13:26 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:13:26 user nova-compute[75285]:       <nova:owner>
Nov 10 21:13:26 user nova-compute[75285]:         <nova:user uuid="a8a625a7d0264f49ad3ddbbdeca81fef">tempest-ServerStableDeviceRescueTest-1367693602-project-member</nova:user>
Nov 10 21:13:26 user nova-compute[75285]:         <nova:project uuid="159848b23a33449aa7eef3b73061912d">tempest-ServerStableDeviceRescueTest-1367693602</nova:project>
Nov 10 21:13:26 user nova-compute[75285]:       </nova:owner>
Nov 10 21:13:26 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:13:26 user nova-compute[75285]:       <nova:ports>
Nov 10 21:13:26 user nova-compute[75285]:         <nova:port uuid="bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef">
Nov 10 21:13:26 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 21:13:26 user nova-compute[75285]:         </nova:port>
Nov 10 21:13:26 user nova-compute[75285]:       </nova:ports>
Nov 10 21:13:26 user nova-compute[75285]:     </nova:instance>
Nov 10 21:13:26 user nova-compute[75285]:   </metadata>
Nov 10 21:13:26 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:13:26 user nova-compute[75285]:     <system>
Nov 10 21:13:26 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:13:26 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:13:26 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:13:26 user nova-compute[75285]:       <entry name="serial">09ab2e54-1189-420e-9e5c-d158e4106ffd</entry>
Nov 10 21:13:26 user nova-compute[75285]:       <entry name="uuid">09ab2e54-1189-420e-9e5c-d158e4106ffd</entry>
Nov 10 21:13:26 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:13:26 user nova-compute[75285]:     </system>
Nov 10 21:13:26 user nova-compute[75285]:   </sysinfo>
Nov 10 21:13:26 user nova-compute[75285]:   <os>
Nov 10 21:13:26 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:13:26 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:13:26 user nova-compute[75285]:   </os>
Nov 10 21:13:26 user nova-compute[75285]:   <features>
Nov 10 21:13:26 user nova-compute[75285]:     <acpi/>
Nov 10 21:13:26 user nova-compute[75285]:     <apic/>
Nov 10 21:13:26 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:13:26 user nova-compute[75285]:   </features>
Nov 10 21:13:26 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:13:26 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:13:26 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:13:26 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:13:26 user nova-compute[75285]:   </clock>
Nov 10 21:13:26 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:13:26 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:13:26 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:13:26 user nova-compute[75285]:   </cpu>
Nov 10 21:13:26 user nova-compute[75285]:   <devices>
Nov 10 21:13:26 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:13:26 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:13:26 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk"/>
Nov 10 21:13:26 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:13:26 user nova-compute[75285]:     </disk>
Nov 10 21:13:26 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:13:26 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:13:26 user nova-compute[75285]:       <source dev="/dev/sdb"/>
Nov 10 21:13:26 user nova-compute[75285]:       <target dev="vdb" bus="virtio"/>
Nov 10 21:13:26 user nova-compute[75285]:       <serial>822836c3-ad6b-4714-a890-5dfb85ba0b19</serial>
Nov 10 21:13:26 user nova-compute[75285]:     </disk>
Nov 10 21:13:26 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:13:26 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:13:26 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.rescue"/>
Nov 10 21:13:26 user nova-compute[75285]:       <target dev="vdc" bus="virtio"/>
Nov 10 21:13:26 user nova-compute[75285]:       <boot order="1"/>
Nov 10 21:13:26 user nova-compute[75285]:     </disk>
Nov 10 21:13:26 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:13:26 user nova-compute[75285]:       <mac address="fa:16:3e:98:9a:13"/>
Nov 10 21:13:26 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:13:26 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:13:26 user nova-compute[75285]:       <target dev="tapbd8d1ec8-27"/>
Nov 10 21:13:26 user nova-compute[75285]:     </interface>
Nov 10 21:13:26 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:13:26 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/console.log" append="off"/>
Nov 10 21:13:26 user nova-compute[75285]:     </serial>
Nov 10 21:13:26 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:13:26 user nova-compute[75285]:     <video>
Nov 10 21:13:26 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:13:26 user nova-compute[75285]:     </video>
Nov 10 21:13:26 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:13:26 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:13:26 user nova-compute[75285]:     </rng>
Nov 10 21:13:26 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:13:26 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:13:26 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:13:26 user nova-compute[75285]:     </memballoon>
Nov 10 21:13:26 user nova-compute[75285]:   </devices>
Nov 10 21:13:26 user nova-compute[75285]: </domain>
Nov 10 21:13:26 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:13:26 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Instance destroyed successfully.
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] No VIF found with MAC fa:16:3e:98:9a:13, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-5ac0c052-46e8-4299-b173-4c0971105cdf req-a95be4a1-7ccf-4639-8956-8a8b982bdd00 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5ac0c052-46e8-4299-b173-4c0971105cdf req-a95be4a1-7ccf-4639-8956-8a8b982bdd00 service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5ac0c052-46e8-4299-b173-4c0971105cdf req-a95be4a1-7ccf-4639-8956-8a8b982bdd00 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5ac0c052-46e8-4299-b173-4c0971105cdf req-a95be4a1-7ccf-4639-8956-8a8b982bdd00 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-5ac0c052-46e8-4299-b173-4c0971105cdf req-a95be4a1-7ccf-4639-8956-8a8b982bdd00 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:26 user nova-compute[75285]: WARNING nova.compute.manager [req-5ac0c052-46e8-4299-b173-4c0971105cdf req-a95be4a1-7ccf-4639-8956-8a8b982bdd00 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state building and task_state spawning.
Nov 10 21:13:27 user nova-compute[75285]: DEBUG nova.compute.manager [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:13:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:13:27 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Instance spawned successfully.
Nov 10 21:13:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:13:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:13:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:13:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:13:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:13:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:13:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:13:27 user nova-compute[75285]: INFO nova.compute.manager [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 10 21:13:27 user nova-compute[75285]: DEBUG nova.compute.manager [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:13:27 user nova-compute[75285]: INFO nova.compute.manager [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Took 45.03 seconds to build instance.
Nov 10 21:13:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6247d9b4-499a-4a1d-9099-eedb598b193f tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.123s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-cb1d18eb-e7db-4f66-9134-843d8a4f169a req-bed1f144-a0ca-4cf6-b3e6-6cb906d6aeca service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cb1d18eb-e7db-4f66-9134-843d8a4f169a req-bed1f144-a0ca-4cf6-b3e6-6cb906d6aeca service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cb1d18eb-e7db-4f66-9134-843d8a4f169a req-bed1f144-a0ca-4cf6-b3e6-6cb906d6aeca service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cb1d18eb-e7db-4f66-9134-843d8a4f169a req-bed1f144-a0ca-4cf6-b3e6-6cb906d6aeca service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-cb1d18eb-e7db-4f66-9134-843d8a4f169a req-bed1f144-a0ca-4cf6-b3e6-6cb906d6aeca service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:28 user nova-compute[75285]: WARNING nova.compute.manager [req-cb1d18eb-e7db-4f66-9134-843d8a4f169a req-bed1f144-a0ca-4cf6-b3e6-6cb906d6aeca service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state active and task_state rescuing.
Nov 10 21:13:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-d6950159-237b-4254-95e7-ca5c9e43d9dc req-fd671f4d-1235-4149-94d3-5a8ffd063441 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d6950159-237b-4254-95e7-ca5c9e43d9dc req-fd671f4d-1235-4149-94d3-5a8ffd063441 service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d6950159-237b-4254-95e7-ca5c9e43d9dc req-fd671f4d-1235-4149-94d3-5a8ffd063441 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d6950159-237b-4254-95e7-ca5c9e43d9dc req-fd671f4d-1235-4149-94d3-5a8ffd063441 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-d6950159-237b-4254-95e7-ca5c9e43d9dc req-fd671f4d-1235-4149-94d3-5a8ffd063441 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:30 user nova-compute[75285]: WARNING nova.compute.manager [req-d6950159-237b-4254-95e7-ca5c9e43d9dc req-fd671f4d-1235-4149-94d3-5a8ffd063441 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state active and task_state rescuing.
Nov 10 21:13:30 user nova-compute[75285]: DEBUG nova.compute.manager [None req-3f740022-9a74-4e3b-8509-1a749df8c0db tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:13:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquiring lock "72a39007-63f0-4f1b-8689-286c55ea1d0c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:33 user nova-compute[75285]: DEBUG nova.objects.instance [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lazy-loading 'flavor' on Instance uuid 72a39007-63f0-4f1b-8689-286c55ea1d0c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquiring lock "72a39007-63f0-4f1b-8689-286c55ea1d0c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:34 user nova-compute[75285]: INFO nova.compute.manager [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Attaching volume afbdecc5-51ba-47b4-b898-38e4ea6c4581 to /dev/vdb
Nov 10 21:13:34 user nova-compute[75285]: DEBUG os_brick.utils [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db3f642-7e78-48f9-9723-4b3c86ac06ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f979391-2a71-4aa2-9850-d8b6c75724a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2999dac-fbe1-47ff-8a8c-72405c490135]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e60c5c-45bf-4728-a8f6-df427808e45f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:13:34 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:13:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d632c2-79a3-4443-b554-5b02d7ac7cec]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG os_brick.utils [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:13:34 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Updating existing volume attachment record: df7c672c-eafb-4811-a3c0-5806e3115355 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:13:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:38 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:13:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-9e3f4d6e-c333-4aea-a09e-d0efbb093aab req-1651e53c-243f-445d-8036-f1ad7f95c2ec service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received event network-changed-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-9e3f4d6e-c333-4aea-a09e-d0efbb093aab req-1651e53c-243f-445d-8036-f1ad7f95c2ec service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Refreshing instance network info cache due to event network-changed-e23cea65-b47d-4daf-8640-b3617916099e. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:13:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9e3f4d6e-c333-4aea-a09e-d0efbb093aab req-1651e53c-243f-445d-8036-f1ad7f95c2ec service nova] Acquiring lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:13:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9e3f4d6e-c333-4aea-a09e-d0efbb093aab req-1651e53c-243f-445d-8036-f1ad7f95c2ec service nova] Acquired lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:13:41 user nova-compute[75285]: DEBUG nova.network.neutron [req-9e3f4d6e-c333-4aea-a09e-d0efbb093aab req-1651e53c-243f-445d-8036-f1ad7f95c2ec service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Refreshing network info cache for port e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:13:41 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:13:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:13:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:13:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:13:41 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:13:42 user nova-compute[75285]: DEBUG nova.network.neutron [req-9e3f4d6e-c333-4aea-a09e-d0efbb093aab req-1651e53c-243f-445d-8036-f1ad7f95c2ec service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Updated VIF entry in instance network info cache for port e23cea65-b47d-4daf-8640-b3617916099e. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:13:42 user nova-compute[75285]: DEBUG nova.network.neutron [req-9e3f4d6e-c333-4aea-a09e-d0efbb093aab req-1651e53c-243f-445d-8036-f1ad7f95c2ec service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Updating instance_info_cache with network_info: [{"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:13:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9e3f4d6e-c333-4aea-a09e-d0efbb093aab req-1651e53c-243f-445d-8036-f1ad7f95c2ec service nova] Releasing lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:13:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:42 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updating instance_info_cache with network_info: [{"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:13:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:13:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:13:42 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:13:42 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:13:42 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:13:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 21:13:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] There are 0 instances to clean {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 21:13:43 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:13:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:43 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:13:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:13:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:13:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:49 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:13:49 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7715MB free_disk=25.12403106689453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "278ff84f-a732-4d81-81e5-74df508c9f11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "278ff84f-a732-4d81-81e5-74df508c9f11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.manager [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 09ab2e54-1189-420e-9e5c-d158e4106ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3a0c67ef-1414-47e0-8769-c9164baf8993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 0ad7b009-e56f-48ae-8643-29abadf283a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 72a39007-63f0-4f1b-8689-286c55ea1d0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 073785c4-a92c-4297-ab62-55c31b424ffc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 278ff84f-a732-4d81-81e5-74df508c9f11 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing inventories for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating ProviderTree inventory for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating inventory in ProviderTree for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing aggregate associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, aggregates: None {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 21:13:49 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing trait associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.900s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.562s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances with incomplete migration  {{(pid=75285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:13:50 user nova-compute[75285]: INFO nova.compute.claims [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Claim successful on node user
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "073785c4-a92c-4297-ab62-55c31b424ffc" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:50 user nova-compute[75285]: INFO nova.compute.manager [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Shelving
Nov 10 21:13:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:13:50 user nova-compute[75285]: INFO nova.compute.manager [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Terminating instance
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.network.neutron [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.compute.manager [req-93de2b32-1f89-4f97-a176-7144d0cd8582 req-e44fe656-0066-42fe-97ff-3c9c361e6bbd service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received event network-vif-unplugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-93de2b32-1f89-4f97-a176-7144d0cd8582 req-e44fe656-0066-42fe-97ff-3c9c361e6bbd service nova] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-93de2b32-1f89-4f97-a176-7144d0cd8582 req-e44fe656-0066-42fe-97ff-3c9c361e6bbd service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-93de2b32-1f89-4f97-a176-7144d0cd8582 req-e44fe656-0066-42fe-97ff-3c9c361e6bbd service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.compute.manager [req-93de2b32-1f89-4f97-a176-7144d0cd8582 req-e44fe656-0066-42fe-97ff-3c9c361e6bbd service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] No waiting events found dispatching network-vif-unplugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:50 user nova-compute[75285]: WARNING nova.compute.manager [req-93de2b32-1f89-4f97-a176-7144d0cd8582 req-e44fe656-0066-42fe-97ff-3c9c361e6bbd service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received unexpected event network-vif-unplugged-e23cea65-b47d-4daf-8640-b3617916099e for instance with vm_state active and task_state shelving.
Nov 10 21:13:50 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:13:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQgSbROa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:13:50 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:13:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:13:50 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:13:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:13:50 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d923cf0-4345-4be0-90a4-6993d0e4aa2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:13:50 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b337e5c-0cf8-433f-b51b-ec9052371a60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437] added
Nov 10 21:13:50 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG nova.policy [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e16c471c0875416aa0eb86d89eef3a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04636b8a9e404d40a3a2bc9f63a4df8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c24f908-c914-4c99-8697-02792137c539]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:51 user nova-compute[75285]: INFO nova.virt.block_device [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Booting with volume aa895f68-63cb-4dad-aedf-9ac3c418b57c at /dev/vda
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[803bbf79-b19d-46f9-9572-70aa24ff4cf7]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQgSbROa {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQgSbROa" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f93d4c-74d0-4784-b932-d5477a05a861]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AQgSbROa'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1ca28a-b08b-4f2c-9c39-bcf91924cc4a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.utils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:51 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Instance destroyed successfully.
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[95345774-45c9-4cf2-a299-f0f84472dc4b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[25328ca9-c747-4ecf-bb7a-358faa22ba07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:13:51 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:13:51 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:13:51 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:13:51 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b7b6cf-bf9a-4c6e-b7d4-7dbaefe0becc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:51 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Beginning cold snapshot process
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8b6f53-2059-4e08-a303-71fcf746d9d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a2e150-ccbd-4fc0-b616-d0019f1cca36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead0a755-a11f-410b-8068-c7b61d27c94b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437, portal: 172.16.0.220,3260]
Nov 10 21:13:51 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437, portal: 172.16.0.220,3260] successful.
Nov 10 21:13:51 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:13:51 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f0021b-e89e-451d-8f46-b10f8f65e262]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.utils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Updating existing volume attachment record: 83b7337f-629c-4192-97cf-88594e75a3ad {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f37182e-3c34-4d09-9b72-221394133402]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[116ad9ee-291e-46e8-8919-fff38597c6ec]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:13:51 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:13:51 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:13:51 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:13:51 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:13:51 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:13:51 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.450s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f57485d-cf01-4552-8b74-4d663750198a]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk /opt/stack/data/nova/instances/snapshots/tmpx2bgalcp/474fdaf0d154490982d5d867b5ab82d9 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:51 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Instance destroyed successfully.
Nov 10 21:13:51 user nova-compute[75285]: DEBUG nova.objects.instance [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lazy-loading 'resources' on Instance uuid 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:11:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1823256661',display_name='tempest-ServersNegativeTestJSON-server-1823256661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1823256661',id=22,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:12:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cea5dc310634b9da5042ae70e713b1e',ramdisk_id='',reservation_id='r-ygv9wtiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-957099376',owner_user_name='tempest-ServersNegativeTestJSON-957099376-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:12:08Z,user_data=None,user_id='353cbd5fff0d4550b72b85c5073ae81d',uuid=3c8c1cd0-d8c4-4efa-ab59-9c451b97646a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59800b1c-b7d3-43de-a4bc-af7be327714d", "address": "fa:16:3e:98:1a:23", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59800b1c-b7", "ovs_interfaceid": "59800b1c-b7d3-43de-a4bc-af7be327714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Converting VIF {"id": "59800b1c-b7d3-43de-a4bc-af7be327714d", "address": "fa:16:3e:98:1a:23", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59800b1c-b7", "ovs_interfaceid": "59800b1c-b7d3-43de-a4bc-af7be327714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:1a:23,bridge_name='br-int',has_traffic_filtering=True,id=59800b1c-b7d3-43de-a4bc-af7be327714d,network=Network(28e1d97a-a55b-41d2-83d4-600aedcecb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59800b1c-b7') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG os_vif [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:1a:23,bridge_name='br-int',has_traffic_filtering=True,id=59800b1c-b7d3-43de-a4bc-af7be327714d,network=Network(28e1d97a-a55b-41d2-83d4-600aedcecb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59800b1c-b7') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59800b1c-b7, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e6081f3-a7fb-4dde-b1a3-15c43a222a6b) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:51 user nova-compute[75285]: INFO os_vif [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:1a:23,bridge_name='br-int',has_traffic_filtering=True,id=59800b1c-b7d3-43de-a4bc-af7be327714d,network=Network(28e1d97a-a55b-41d2-83d4-600aedcecb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59800b1c-b7')
Nov 10 21:13:51 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Deleting instance files /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a_del
Nov 10 21:13:51 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Deletion of /opt/stack/data/nova/instances/3c8c1cd0-d8c4-4efa-ab59-9c451b97646a_del complete
Nov 10 21:13:51 user nova-compute[75285]: INFO nova.compute.manager [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 10 21:13:51 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:13:51 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.network.neutron [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Successfully created port: 05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk /opt/stack/data/nova/instances/snapshots/tmpx2bgalcp/474fdaf0d154490982d5d867b5ab82d9" returned: 0 in 0.906s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:52 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Snapshot extracted, beginning image upload
Nov 10 21:13:52 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQgSbROa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.492s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] <== connect_volume: return (1494ms) {'type': 'block', 'scsi_wwn': '23161646133313531', 'path': '/dev/sdd'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161646133313531', 'path': '/dev/sdd'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.objects.instance [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'flavor' on Instance uuid 0ad7b009-e56f-48ae-8643-29abadf283a4 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:13:52 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:13:52 user nova-compute[75285]:   <source dev="/dev/sdd"/>
Nov 10 21:13:52 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:13:52 user nova-compute[75285]:   <serial>e333f9e0-5446-4abf-8485-6f02b10ae437</serial>
Nov 10 21:13:52 user nova-compute[75285]: </disk>
Nov 10 21:13:52 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No VIF found with MAC fa:16:3e:1c:3e:8b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.compute.manager [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received event network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.compute.manager [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] No waiting events found dispatching network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:52 user nova-compute[75285]: WARNING nova.compute.manager [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received unexpected event network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.compute.manager [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Received event network-vif-unplugged-59800b1c-b7d3-43de-a4bc-af7be327714d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] Acquiring lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] Lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] Lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.compute.manager [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] No waiting events found dispatching network-vif-unplugged-59800b1c-b7d3-43de-a4bc-af7be327714d {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.compute.manager [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Received event network-vif-unplugged-59800b1c-b7d3-43de-a4bc-af7be327714d for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.compute.manager [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Received event network-vif-plugged-59800b1c-b7d3-43de-a4bc-af7be327714d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] Acquiring lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] Lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] Lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.compute.manager [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] No waiting events found dispatching network-vif-plugged-59800b1c-b7d3-43de-a4bc-af7be327714d {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:52 user nova-compute[75285]: WARNING nova.compute.manager [req-fac36239-2346-494c-b730-55dff5d5e326 req-1c924837-3b32-42e4-93c5-aeba399fe185 service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Received unexpected event network-vif-plugged-59800b1c-b7d3-43de-a4bc-af7be327714d for instance with vm_state active and task_state deleting.
Nov 10 21:13:52 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Took 1.22 seconds to deallocate network for instance.
Nov 10 21:13:52 user nova-compute[75285]: DEBUG nova.compute.manager [req-83600fe5-2617-4c45-ba6c-3120bef61bc9 req-6e72c5d9-658a-4081-9793-b06c1c1414cb service nova] [instance: 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a] Received event network-vif-deleted-59800b1c-b7d3-43de-a4bc-af7be327714d {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:53 user nova-compute[75285]: DEBUG nova.network.neutron [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Successfully updated port: 05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:13:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "refresh_cache-278ff84f-a732-4d81-81e5-74df508c9f11" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:13:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquired lock "refresh_cache-278ff84f-a732-4d81-81e5-74df508c9f11" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:13:53 user nova-compute[75285]: DEBUG nova.network.neutron [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:13:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-81305c98-54a8-427b-ac05-32a215c4cd49 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.757s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:53 user nova-compute[75285]: DEBUG nova.network.neutron [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:13:53 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:13:53 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:13:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.577s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:53 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Deleted allocations for instance 3c8c1cd0-d8c4-4efa-ab59-9c451b97646a
Nov 10 21:13:53 user nova-compute[75285]: DEBUG nova.network.neutron [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Updating instance_info_cache with network_info: [{"id": "05305385-566b-49c0-a6c0-50fb2b7e9170", "address": "fa:16:3e:b5:0e:61", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05305385-56", "ovs_interfaceid": "05305385-566b-49c0-a6c0-50fb2b7e9170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:13:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Releasing lock "refresh_cache-278ff84f-a732-4d81-81e5-74df508c9f11" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:13:53 user nova-compute[75285]: DEBUG nova.compute.manager [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Instance network_info: |[{"id": "05305385-566b-49c0-a6c0-50fb2b7e9170", "address": "fa:16:3e:b5:0e:61", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05305385-56", "ovs_interfaceid": "05305385-566b-49c0-a6c0-50fb2b7e9170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:13:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-88805de7-e150-4af7-9d50-d2d40c6e0517 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "3c8c1cd0-d8c4-4efa-ab59-9c451b97646a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.028s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:54 user nova-compute[75285]: INFO nova.compute.manager [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Rescuing
Nov 10 21:13:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:13:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquired lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:13:54 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:13:54 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Updating instance_info_cache with network_info: [{"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:13:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Releasing lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:13:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG nova.compute.manager [req-646b6e7f-b0c1-44c4-8f02-f62cab69d1e4 req-cf372004-d525-4f3b-a619-37ed3c91b85e service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Received event network-changed-05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG nova.compute.manager [req-646b6e7f-b0c1-44c4-8f02-f62cab69d1e4 req-cf372004-d525-4f3b-a619-37ed3c91b85e service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Refreshing instance network info cache due to event network-changed-05305385-566b-49c0-a6c0-50fb2b7e9170. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-646b6e7f-b0c1-44c4-8f02-f62cab69d1e4 req-cf372004-d525-4f3b-a619-37ed3c91b85e service nova] Acquiring lock "refresh_cache-278ff84f-a732-4d81-81e5-74df508c9f11" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-646b6e7f-b0c1-44c4-8f02-f62cab69d1e4 req-cf372004-d525-4f3b-a619-37ed3c91b85e service nova] Acquired lock "refresh_cache-278ff84f-a732-4d81-81e5-74df508c9f11" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG nova.network.neutron [req-646b6e7f-b0c1-44c4-8f02-f62cab69d1e4 req-cf372004-d525-4f3b-a619-37ed3c91b85e service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Refreshing network info cache for port 05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:55 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Snapshot image upload complete
Nov 10 21:13:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:13:55 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Instance destroyed successfully.
Nov 10 21:13:55 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Attempting rescue
Nov 10 21:13:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75285) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Instance directory exists: not creating {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 21:13:55 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Creating image(s)
Nov 10 21:13:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "/opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "/opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0ad7b009-e56f-48ae-8643-29abadf283a4 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:55 user nova-compute[75285]: INFO nova.compute.manager [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Shelve offloading
Nov 10 21:13:55 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Instance destroyed successfully.
Nov 10 21:13:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquired lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG nova.network.neutron [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk.rescue {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk.rescue" returned: 0 in 0.054s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:13:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'migration_context' on Instance uuid 0ad7b009-e56f-48ae-8643-29abadf283a4 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.objects.base [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<0ad7b009-e56f-48ae-8643-29abadf283a4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Start _get_guest_xml network_info=[{"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "vif_mac": "fa:16:3e:1c:3e:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'resources' on Instance uuid 0ad7b009-e56f-48ae-8643-29abadf283a4 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.objects.base [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<0ad7b009-e56f-48ae-8643-29abadf283a4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ad7b009-e56f-48ae-8643-29abadf283a4 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.objects.base [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<0ad7b009-e56f-48ae-8643-29abadf283a4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:13:56 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:13:56 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ad7b009-e56f-48ae-8643-29abadf283a4 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.objects.base [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<0ad7b009-e56f-48ae-8643-29abadf283a4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-296914162',display_name='tempest-ServerRescueNegativeTestJSON-server-296914162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-296914162',id=18,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZO1bKLdjQN9DGspd4XutMTTKdyiBAMV6FMPoy2h7xkksoFYNkPa1t1BqodYNZWKqcnnIbgjknrj76HYMDIeWcvHN/RKtVyptYqOXFGz/EWmZDGBaxg8oPRKR0yssggfA==',key_name='tempest-keypair-822010462',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44979c0f5b7d4205a0e5e0becbe714cb',ramdisk_id='',reservation_id='r-oeqrgq9r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-418662944',owner_user_name='tempest-ServerRescueNegativeTestJSON-418662944-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:11:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9c20460877a428e9fa97869ba34eb04',uuid=0ad7b009-e56f-48ae-8643-29abadf283a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "vif_mac": "fa:16:3e:1c:3e:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converting VIF {"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "vif_mac": "fa:16:3e:1c:3e:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:3e:8b,bridge_name='br-int',has_traffic_filtering=True,id=ea61ffb9-f415-4c97-850b-56d25719be25,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea61ffb9-f4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ad7b009-e56f-48ae-8643-29abadf283a4 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.network.neutron [req-646b6e7f-b0c1-44c4-8f02-f62cab69d1e4 req-cf372004-d525-4f3b-a619-37ed3c91b85e service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Updated VIF entry in instance network info cache for port 05305385-566b-49c0-a6c0-50fb2b7e9170. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.network.neutron [req-646b6e7f-b0c1-44c4-8f02-f62cab69d1e4 req-cf372004-d525-4f3b-a619-37ed3c91b85e service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Updating instance_info_cache with network_info: [{"id": "05305385-566b-49c0-a6c0-50fb2b7e9170", "address": "fa:16:3e:b5:0e:61", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05305385-56", "ovs_interfaceid": "05305385-566b-49c0-a6c0-50fb2b7e9170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.objects.base [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Object Instance<0ad7b009-e56f-48ae-8643-29abadf283a4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:13:56 user nova-compute[75285]:   <uuid>0ad7b009-e56f-48ae-8643-29abadf283a4</uuid>
Nov 10 21:13:56 user nova-compute[75285]:   <name>instance-00000012</name>
Nov 10 21:13:56 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:13:56 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:13:56 user nova-compute[75285]:   <metadata>
Nov 10 21:13:56 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:13:56 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:13:56 user nova-compute[75285]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-296914162</nova:name>
Nov 10 21:13:56 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:13:56</nova:creationTime>
Nov 10 21:13:56 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:13:56 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:13:56 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:13:56 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:13:56 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:13:56 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:13:56 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:13:56 user nova-compute[75285]:       <nova:owner>
Nov 10 21:13:56 user nova-compute[75285]:         <nova:user uuid="b9c20460877a428e9fa97869ba34eb04">tempest-ServerRescueNegativeTestJSON-418662944-project-member</nova:user>
Nov 10 21:13:56 user nova-compute[75285]:         <nova:project uuid="44979c0f5b7d4205a0e5e0becbe714cb">tempest-ServerRescueNegativeTestJSON-418662944</nova:project>
Nov 10 21:13:56 user nova-compute[75285]:       </nova:owner>
Nov 10 21:13:56 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:13:56 user nova-compute[75285]:       <nova:ports>
Nov 10 21:13:56 user nova-compute[75285]:         <nova:port uuid="ea61ffb9-f415-4c97-850b-56d25719be25">
Nov 10 21:13:56 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 21:13:56 user nova-compute[75285]:         </nova:port>
Nov 10 21:13:56 user nova-compute[75285]:       </nova:ports>
Nov 10 21:13:56 user nova-compute[75285]:     </nova:instance>
Nov 10 21:13:56 user nova-compute[75285]:   </metadata>
Nov 10 21:13:56 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:13:56 user nova-compute[75285]:     <system>
Nov 10 21:13:56 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:13:56 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:13:56 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:13:56 user nova-compute[75285]:       <entry name="serial">0ad7b009-e56f-48ae-8643-29abadf283a4</entry>
Nov 10 21:13:56 user nova-compute[75285]:       <entry name="uuid">0ad7b009-e56f-48ae-8643-29abadf283a4</entry>
Nov 10 21:13:56 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:13:56 user nova-compute[75285]:     </system>
Nov 10 21:13:56 user nova-compute[75285]:   </sysinfo>
Nov 10 21:13:56 user nova-compute[75285]:   <os>
Nov 10 21:13:56 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:13:56 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:13:56 user nova-compute[75285]:   </os>
Nov 10 21:13:56 user nova-compute[75285]:   <features>
Nov 10 21:13:56 user nova-compute[75285]:     <acpi/>
Nov 10 21:13:56 user nova-compute[75285]:     <apic/>
Nov 10 21:13:56 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:13:56 user nova-compute[75285]:   </features>
Nov 10 21:13:56 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:13:56 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:13:56 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:13:56 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:13:56 user nova-compute[75285]:   </clock>
Nov 10 21:13:56 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:13:56 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:13:56 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:13:56 user nova-compute[75285]:   </cpu>
Nov 10 21:13:56 user nova-compute[75285]:   <devices>
Nov 10 21:13:56 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:13:56 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:13:56 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk.rescue"/>
Nov 10 21:13:56 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:13:56 user nova-compute[75285]:     </disk>
Nov 10 21:13:56 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:13:56 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:13:56 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk"/>
Nov 10 21:13:56 user nova-compute[75285]:       <target dev="vdb" bus="virtio"/>
Nov 10 21:13:56 user nova-compute[75285]:     </disk>
Nov 10 21:13:56 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:13:56 user nova-compute[75285]:       <mac address="fa:16:3e:1c:3e:8b"/>
Nov 10 21:13:56 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:13:56 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:13:56 user nova-compute[75285]:       <target dev="tapea61ffb9-f4"/>
Nov 10 21:13:56 user nova-compute[75285]:     </interface>
Nov 10 21:13:56 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:13:56 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/console.log" append="off"/>
Nov 10 21:13:56 user nova-compute[75285]:     </serial>
Nov 10 21:13:56 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:13:56 user nova-compute[75285]:     <video>
Nov 10 21:13:56 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:13:56 user nova-compute[75285]:     </video>
Nov 10 21:13:56 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:13:56 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:13:56 user nova-compute[75285]:     </rng>
Nov 10 21:13:56 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:13:56 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:13:56 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:13:56 user nova-compute[75285]:     </memballoon>
Nov 10 21:13:56 user nova-compute[75285]:   </devices>
Nov 10 21:13:56 user nova-compute[75285]: </domain>
Nov 10 21:13:56 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-646b6e7f-b0c1-44c4-8f02-f62cab69d1e4 req-cf372004-d525-4f3b-a619-37ed3c91b85e service nova] Releasing lock "refresh_cache-278ff84f-a732-4d81-81e5-74df508c9f11" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:13:56 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Instance destroyed successfully.
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] No VIF found with MAC fa:16:3e:1c:3e:8b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Updating instance_info_cache with network_info: [{"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Releasing lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:13:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:57 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Instance destroyed successfully.
Nov 10 21:13:57 user nova-compute[75285]: DEBUG nova.objects.instance [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'resources' on Instance uuid 073785c4-a92c-4297-ab62-55c31b424ffc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-232bd10c-94d4-4d78-a5bd-d593ba4c235a req-c1b2efa1-976f-489d-ac33-0e508ebbd91a service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-vif-unplugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-232bd10c-94d4-4d78-a5bd-d593ba4c235a req-c1b2efa1-976f-489d-ac33-0e508ebbd91a service nova] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-232bd10c-94d4-4d78-a5bd-d593ba4c235a req-c1b2efa1-976f-489d-ac33-0e508ebbd91a service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-232bd10c-94d4-4d78-a5bd-d593ba4c235a req-c1b2efa1-976f-489d-ac33-0e508ebbd91a service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-232bd10c-94d4-4d78-a5bd-d593ba4c235a req-c1b2efa1-976f-489d-ac33-0e508ebbd91a service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] No waiting events found dispatching network-vif-unplugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:57 user nova-compute[75285]: WARNING nova.compute.manager [req-232bd10c-94d4-4d78-a5bd-d593ba4c235a req-c1b2efa1-976f-489d-ac33-0e508ebbd91a service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received unexpected event network-vif-unplugged-ea61ffb9-f415-4c97-850b-56d25719be25 for instance with vm_state active and task_state rescuing.
Nov 10 21:13:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-232bd10c-94d4-4d78-a5bd-d593ba4c235a req-c1b2efa1-976f-489d-ac33-0e508ebbd91a service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-232bd10c-94d4-4d78-a5bd-d593ba4c235a req-c1b2efa1-976f-489d-ac33-0e508ebbd91a service nova] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-232bd10c-94d4-4d78-a5bd-d593ba4c235a req-c1b2efa1-976f-489d-ac33-0e508ebbd91a service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-232bd10c-94d4-4d78-a5bd-d593ba4c235a req-c1b2efa1-976f-489d-ac33-0e508ebbd91a service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-232bd10c-94d4-4d78-a5bd-d593ba4c235a req-c1b2efa1-976f-489d-ac33-0e508ebbd91a service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] No waiting events found dispatching network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:57 user nova-compute[75285]: WARNING nova.compute.manager [req-232bd10c-94d4-4d78-a5bd-d593ba4c235a req-c1b2efa1-976f-489d-ac33-0e508ebbd91a service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received unexpected event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 for instance with vm_state active and task_state rescuing.
Nov 10 21:13:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:11:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-252199540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-252199540',id=20,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrGHdrWmXZnDobcBkLbJDGNOuNulhOQtjTZ0Td0zuu4Ik7AfZ4rcF63yRHtlxB6ukOXyIp7pnw4VEbd9lzTdIAPD9ZB8MrI5zYYtAh7DVkigItt1bjyVEFS0OXB4+k5sQ==',key_name='tempest-keypair-1489604129',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:11:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='846fec1848ac4cbfa88b60ba0cf98e3c',ramdisk_id='',reservation_id='r-fi8ja34n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-605808320',owner_user_name='tempest-AttachVolumeShelveTestJSON-605808320-project-member',shelved_at='2023-11-10T21:13:55.669809',shelved_host='user',shelved_image_id='61c881d9-7940-4287-b8fa-21e2ba9d18a5'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51709428ae324620840611f8eb1c216f',uuid=073785c4-a92c-4297-ab62-55c31b424ffc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converting VIF {"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=e23cea65-b47d-4daf-8640-b3617916099e,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape23cea65-b4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG os_vif [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=e23cea65-b47d-4daf-8640-b3617916099e,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape23cea65-b4') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape23cea65-b4, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d67e9a7-2fdd-4d6c-a627-255247706366) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:57 user nova-compute[75285]: INFO os_vif [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=e23cea65-b47d-4daf-8640-b3617916099e,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape23cea65-b4')
Nov 10 21:13:57 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Deleting instance files /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc_del
Nov 10 21:13:57 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Deletion of /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc_del complete
Nov 10 21:13:57 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Deleted allocations for instance 073785c4-a92c-4297-ab62-55c31b424ffc
Nov 10 21:13:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG nova.objects.instance [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'numa_topology' on Instance uuid 073785c4-a92c-4297-ab62-55c31b424ffc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG nova.objects.base [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Object Instance<073785c4-a92c-4297-ab62-55c31b424ffc> lazy-loaded attributes: resources,numa_topology {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-218c4efe-7b1c-4f6e-8c63-8ec6e16afe14 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "073785c4-a92c-4297-ab62-55c31b424ffc" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.649s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:13:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-8d708a7e-0c0a-4f9a-9af1-9779956d96a0 req-def70127-7cad-4569-88ed-17f4c9209688 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8d708a7e-0c0a-4f9a-9af1-9779956d96a0 req-def70127-7cad-4569-88ed-17f4c9209688 service nova] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8d708a7e-0c0a-4f9a-9af1-9779956d96a0 req-def70127-7cad-4569-88ed-17f4c9209688 service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8d708a7e-0c0a-4f9a-9af1-9779956d96a0 req-def70127-7cad-4569-88ed-17f4c9209688 service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-8d708a7e-0c0a-4f9a-9af1-9779956d96a0 req-def70127-7cad-4569-88ed-17f4c9209688 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] No waiting events found dispatching network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:59 user nova-compute[75285]: WARNING nova.compute.manager [req-8d708a7e-0c0a-4f9a-9af1-9779956d96a0 req-def70127-7cad-4569-88ed-17f4c9209688 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received unexpected event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 for instance with vm_state active and task_state rescuing.
Nov 10 21:13:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-8d708a7e-0c0a-4f9a-9af1-9779956d96a0 req-def70127-7cad-4569-88ed-17f4c9209688 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:13:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8d708a7e-0c0a-4f9a-9af1-9779956d96a0 req-def70127-7cad-4569-88ed-17f4c9209688 service nova] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:13:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8d708a7e-0c0a-4f9a-9af1-9779956d96a0 req-def70127-7cad-4569-88ed-17f4c9209688 service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:13:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8d708a7e-0c0a-4f9a-9af1-9779956d96a0 req-def70127-7cad-4569-88ed-17f4c9209688 service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:13:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-8d708a7e-0c0a-4f9a-9af1-9779956d96a0 req-def70127-7cad-4569-88ed-17f4c9209688 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] No waiting events found dispatching network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:13:59 user nova-compute[75285]: WARNING nova.compute.manager [req-8d708a7e-0c0a-4f9a-9af1-9779956d96a0 req-def70127-7cad-4569-88ed-17f4c9209688 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received unexpected event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 for instance with vm_state active and task_state rescuing.
Nov 10 21:14:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8b83a4a5-455b-4045-86f8-f36279c98b00 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:14:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UymrsYid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:14:04 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:14:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:14:04 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:14:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:14:04 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b967240c-22ae-49e6-910e-85a35e0296f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:14:04 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.043s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9220399-36f6-4f87-afe0-251776cc21a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581] added
Nov 10 21:14:04 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22bedf6-87a0-4c35-94d5-8c8fcb8f5df9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[db240fdd-bb39-41b8-8d1f-aabdbb2235bb]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UymrsYid {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UymrsYid" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d040003-e47d-40f1-a9a9-6c154e284f28]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UymrsYid'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fba06b-ecda-45d2-9e4e-4ba694d4e8cc]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d328df4-8a5d-4e56-afb9-55d5d4e52fd3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:14:04 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:14:04 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:14:04 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:14:04 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:14:04 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:14:04 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d491bbb-15ff-4ad1-932e-32b157f5690f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581, portal: 172.16.0.220,3260]
Nov 10 21:14:04 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581, portal: 172.16.0.220,3260] successful.
Nov 10 21:14:04 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ca237d-b3d7-4fbb-b83a-9f47295b3572]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "679abba8-40e6-4489-a34f-d4ae6843387b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "679abba8-40e6-4489-a34f-d4ae6843387b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30a74a4-7b02-4358-900b-b4bc3bda4fdc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:14:05 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:14:05 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:14:05 user nova-compute[75285]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 (non-flash)
Nov 10 21:14:05 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:14:05 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:14:05 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:14:05 user nova-compute[75285]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 (non-flash)
Nov 10 21:14:05 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.440s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.032s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6eaa81-1a9c-4c76-a8a8-4109d0b71d8b]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UymrsYid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:14:05 user nova-compute[75285]: INFO nova.compute.claims [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Claim successful on node user
Nov 10 21:14:05 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.685s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG nova.compute.manager [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG nova.network.neutron [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:14:06 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:14:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] <== connect_volume: return (1493ms) {'type': 'block', 'scsi_wwn': '23663656637303532', 'path': '/dev/sde'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663656637303532', 'path': '/dev/sde'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG nova.objects.instance [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lazy-loading 'flavor' on Instance uuid 72a39007-63f0-4f1b-8689-286c55ea1d0c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG nova.compute.manager [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:14:06 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:14:06 user nova-compute[75285]:   <source dev="/dev/sde"/>
Nov 10 21:14:06 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:14:06 user nova-compute[75285]:   <serial>afbdecc5-51ba-47b4-b898-38e4ea6c4581</serial>
Nov 10 21:14:06 user nova-compute[75285]: </disk>
Nov 10 21:14:06 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG nova.policy [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '187d346b3e1b453e8404662727b21a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e582cea01cf0449fad27fafe0f2d0b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG nova.compute.manager [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:14:06 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Creating image(s)
Nov 10 21:14:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "/opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "/opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "/opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.215s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] No VIF found with MAC fa:16:3e:6d:b9:79, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.238s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk 1073741824" returned: 0 in 0.063s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f96c2986-ecd0-4e65-911e-057f3c908558 tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.920s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.238s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Checking if we can resize image /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG nova.network.neutron [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Successfully created port: a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Cannot resize image /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Ensure instance console log exists: /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquiring lock "72a39007-63f0-4f1b-8689-286c55ea1d0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquiring lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:07 user nova-compute[75285]: INFO nova.compute.manager [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Terminating instance
Nov 10 21:14:07 user nova-compute[75285]: DEBUG nova.compute.manager [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:14:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.network.neutron [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Successfully updated port: a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquired lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.network.neutron [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.compute.manager [req-9cd0b6d9-dab8-4258-98eb-fa67f3e56632 req-3e18391f-880f-4c2f-a328-0007986183c3 service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Received event network-changed-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.compute.manager [req-9cd0b6d9-dab8-4258-98eb-fa67f3e56632 req-3e18391f-880f-4c2f-a328-0007986183c3 service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Refreshing instance network info cache due to event network-changed-a04ef93a-fdc5-4229-a69a-1b2daf6f5995. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9cd0b6d9-dab8-4258-98eb-fa67f3e56632 req-3e18391f-880f-4c2f-a328-0007986183c3 service nova] Acquiring lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.compute.manager [req-9870b26d-f308-4077-8910-88bdeb6f412b req-d3dc5d40-03be-43f6-857b-2a603740f913 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Received event network-vif-unplugged-365cab06-6f34-462e-95e8-e2a687de3a45 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9870b26d-f308-4077-8910-88bdeb6f412b req-d3dc5d40-03be-43f6-857b-2a603740f913 service nova] Acquiring lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9870b26d-f308-4077-8910-88bdeb6f412b req-d3dc5d40-03be-43f6-857b-2a603740f913 service nova] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9870b26d-f308-4077-8910-88bdeb6f412b req-d3dc5d40-03be-43f6-857b-2a603740f913 service nova] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.compute.manager [req-9870b26d-f308-4077-8910-88bdeb6f412b req-d3dc5d40-03be-43f6-857b-2a603740f913 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] No waiting events found dispatching network-vif-unplugged-365cab06-6f34-462e-95e8-e2a687de3a45 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.compute.manager [req-9870b26d-f308-4077-8910-88bdeb6f412b req-d3dc5d40-03be-43f6-857b-2a603740f913 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Received event network-vif-unplugged-365cab06-6f34-462e-95e8-e2a687de3a45 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.network.neutron [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:14:08 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Instance destroyed successfully.
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.objects.instance [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lazy-loading 'resources' on Instance uuid 72a39007-63f0-4f1b-8689-286c55ea1d0c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.network.neutron [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updating instance_info_cache with network_info: [{"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2014523589',display_name='tempest-DeleteServersTestJSON-server-2014523589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2014523589',id=19,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:11:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc24a39d61f54c2791450912c1be7979',ramdisk_id='',reservation_id='r-q06zdm3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2100112621',owner_user_name='tempest-DeleteServersTestJSON-2100112621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:11:44Z,user_data=None,user_id='981d0b2799324071ae1a6a3913771284',uuid=72a39007-63f0-4f1b-8689-286c55ea1d0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "365cab06-6f34-462e-95e8-e2a687de3a45", "address": "fa:16:3e:6d:b9:79", "network": {"id": "c0b03adc-d01b-42c3-9244-04fe32e5710a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646536397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc24a39d61f54c2791450912c1be7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365cab06-6f", "ovs_interfaceid": "365cab06-6f34-462e-95e8-e2a687de3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Converting VIF {"id": "365cab06-6f34-462e-95e8-e2a687de3a45", "address": "fa:16:3e:6d:b9:79", "network": {"id": "c0b03adc-d01b-42c3-9244-04fe32e5710a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1646536397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc24a39d61f54c2791450912c1be7979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365cab06-6f", "ovs_interfaceid": "365cab06-6f34-462e-95e8-e2a687de3a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b9:79,bridge_name='br-int',has_traffic_filtering=True,id=365cab06-6f34-462e-95e8-e2a687de3a45,network=Network(c0b03adc-d01b-42c3-9244-04fe32e5710a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365cab06-6f') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG os_vif [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b9:79,bridge_name='br-int',has_traffic_filtering=True,id=365cab06-6f34-462e-95e8-e2a687de3a45,network=Network(c0b03adc-d01b-42c3-9244-04fe32e5710a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365cab06-6f') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap365cab06-6f, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Releasing lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Instance network_info: |[{"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9cd0b6d9-dab8-4258-98eb-fa67f3e56632 req-3e18391f-880f-4c2f-a328-0007986183c3 service nova] Acquired lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.network.neutron [req-9cd0b6d9-dab8-4258-98eb-fa67f3e56632 req-3e18391f-880f-4c2f-a328-0007986183c3 service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Refreshing network info cache for port a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Start _get_guest_xml network_info=[{"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d832cb8-8275-44a8-96de-29ed30ae6cd7) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: INFO os_vif [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b9:79,bridge_name='br-int',has_traffic_filtering=True,id=365cab06-6f34-462e-95e8-e2a687de3a45,network=Network(c0b03adc-d01b-42c3-9244-04fe32e5710a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365cab06-6f')
Nov 10 21:14:08 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:14:08 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UymrsYid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:14:08 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:14:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1798779813',display_name='tempest-ServerActionsTestOtherA-server-1798779813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1798779813',id=26,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNocB749eAh1ht70oz3+10TmA+kLO5gT3lO99nuOm/718owWWR2GClqTfZpHiNdbMnB4WiPNwkXG5KSL2FG22jImExVTOG7tujQLm5tLOPWUZCjIe4jEv2VBcQIF83dwVQ==',key_name='tempest-keypair-1851905805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-f89lru1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:14:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=679abba8-40e6-4489-a34f-d4ae6843387b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:ef:29,bridge_name='br-int',has_traffic_filtering=True,id=a04ef93a-fdc5-4229-a69a-1b2daf6f5995,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04ef93a-fd') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.objects.instance [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lazy-loading 'pci_devices' on Instance uuid 679abba8-40e6-4489-a34f-d4ae6843387b {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[319d9da3-9353-4802-a4fb-66c09ef070d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:14:08 user nova-compute[75285]: No targets found.
Nov 10 21:14:08 user nova-compute[75285]: iSNS:
Nov 10 21:14:08 user nova-compute[75285]: No targets found.
Nov 10 21:14:08 user nova-compute[75285]: STATIC:
Nov 10 21:14:08 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:14:08 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:14:08 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:14:08 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437
Nov 10 21:14:08 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:14:08 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:14:08 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581
Nov 10 21:14:08 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:14:08 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:14:08 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19
Nov 10 21:14:08 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:14:08 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:14:08 user nova-compute[75285]: FIRMWARE:
Nov 10 21:14:08 user nova-compute[75285]: No targets found.
Nov 10 21:14:08 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:14:08 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:14:08 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:14:08 user nova-compute[75285]:   <uuid>679abba8-40e6-4489-a34f-d4ae6843387b</uuid>
Nov 10 21:14:08 user nova-compute[75285]:   <name>instance-0000001a</name>
Nov 10 21:14:08 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:14:08 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:14:08 user nova-compute[75285]:   <metadata>
Nov 10 21:14:08 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:14:08 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:14:08 user nova-compute[75285]:       <nova:name>tempest-ServerActionsTestOtherA-server-1798779813</nova:name>
Nov 10 21:14:08 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:14:08</nova:creationTime>
Nov 10 21:14:08 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:14:08 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:14:08 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:14:08 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:14:08 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:14:08 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:14:08 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:14:08 user nova-compute[75285]:       <nova:owner>
Nov 10 21:14:08 user nova-compute[75285]:         <nova:user uuid="187d346b3e1b453e8404662727b21a7f">tempest-ServerActionsTestOtherA-1895961867-project-member</nova:user>
Nov 10 21:14:08 user nova-compute[75285]:         <nova:project uuid="e582cea01cf0449fad27fafe0f2d0b4e">tempest-ServerActionsTestOtherA-1895961867</nova:project>
Nov 10 21:14:08 user nova-compute[75285]:       </nova:owner>
Nov 10 21:14:08 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:14:08 user nova-compute[75285]:       <nova:ports>
Nov 10 21:14:08 user nova-compute[75285]:         <nova:port uuid="a04ef93a-fdc5-4229-a69a-1b2daf6f5995">
Nov 10 21:14:08 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 21:14:08 user nova-compute[75285]:         </nova:port>
Nov 10 21:14:08 user nova-compute[75285]:       </nova:ports>
Nov 10 21:14:08 user nova-compute[75285]:     </nova:instance>
Nov 10 21:14:08 user nova-compute[75285]:   </metadata>
Nov 10 21:14:08 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:14:08 user nova-compute[75285]:     <system>
Nov 10 21:14:08 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:14:08 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:14:08 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:14:08 user nova-compute[75285]:       <entry name="serial">679abba8-40e6-4489-a34f-d4ae6843387b</entry>
Nov 10 21:14:08 user nova-compute[75285]:       <entry name="uuid">679abba8-40e6-4489-a34f-d4ae6843387b</entry>
Nov 10 21:14:08 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:14:08 user nova-compute[75285]:     </system>
Nov 10 21:14:08 user nova-compute[75285]:   </sysinfo>
Nov 10 21:14:08 user nova-compute[75285]:   <os>
Nov 10 21:14:08 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:14:08 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:14:08 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:14:08 user nova-compute[75285]:   </os>
Nov 10 21:14:08 user nova-compute[75285]:   <features>
Nov 10 21:14:08 user nova-compute[75285]:     <acpi/>
Nov 10 21:14:08 user nova-compute[75285]:     <apic/>
Nov 10 21:14:08 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:14:08 user nova-compute[75285]:   </features>
Nov 10 21:14:08 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:14:08 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:14:08 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:14:08 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:14:08 user nova-compute[75285]:   </clock>
Nov 10 21:14:08 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:14:08 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:14:08 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:14:08 user nova-compute[75285]:   </cpu>
Nov 10 21:14:08 user nova-compute[75285]:   <devices>
Nov 10 21:14:08 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:14:08 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:14:08 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk"/>
Nov 10 21:14:08 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:14:08 user nova-compute[75285]:     </disk>
Nov 10 21:14:08 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:14:08 user nova-compute[75285]:       <mac address="fa:16:3e:62:ef:29"/>
Nov 10 21:14:08 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:14:08 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:14:08 user nova-compute[75285]:       <target dev="tapa04ef93a-fd"/>
Nov 10 21:14:08 user nova-compute[75285]:     </interface>
Nov 10 21:14:08 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:14:08 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/console.log" append="off"/>
Nov 10 21:14:08 user nova-compute[75285]:     </serial>
Nov 10 21:14:08 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:14:08 user nova-compute[75285]:     <video>
Nov 10 21:14:08 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:14:08 user nova-compute[75285]:     </video>
Nov 10 21:14:08 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:14:08 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:14:08 user nova-compute[75285]:     </rng>
Nov 10 21:14:08 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:14:08 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:14:08 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:14:08 user nova-compute[75285]:     </memballoon>
Nov 10 21:14:08 user nova-compute[75285]:   </devices>
Nov 10 21:14:08 user nova-compute[75285]: </domain>
Nov 10 21:14:08 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1798779813',display_name='tempest-ServerActionsTestOtherA-server-1798779813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1798779813',id=26,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNocB749eAh1ht70oz3+10TmA+kLO5gT3lO99nuOm/718owWWR2GClqTfZpHiNdbMnB4WiPNwkXG5KSL2FG22jImExVTOG7tujQLm5tLOPWUZCjIe4jEv2VBcQIF83dwVQ==',key_name='tempest-keypair-1851905805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-f89lru1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:14:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=679abba8-40e6-4489-a34f-d4ae6843387b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:ef:29,bridge_name='br-int',has_traffic_filtering=True,id=a04ef93a-fdc5-4229-a69a-1b2daf6f5995,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04ef93a-fd') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG os_vif [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:ef:29,bridge_name='br-int',has_traffic_filtering=True,id=a04ef93a-fdc5-4229-a69a-1b2daf6f5995,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04ef93a-fd') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '596d8e2c-5455-5945-bd89-1d5c5e0a12fd', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bbaa6c-43d6-43c6-a24b-dd12cf1230bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa04ef93a-fd, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa04ef93a-fd, col_values=(('qos', UUID('f6aed765-3dcf-4fe6-a9ce-f91d1eec294c')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa04ef93a-fd, col_values=(('external_ids', {'iface-id': 'a04ef93a-fdc5-4229-a69a-1b2daf6f5995', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:ef:29', 'vm-uuid': '679abba8-40e6-4489-a34f-d4ae6843387b'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:08 user nova-compute[75285]: INFO os_vif [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:ef:29,bridge_name='br-int',has_traffic_filtering=True,id=a04ef93a-fdc5-4229-a69a-1b2daf6f5995,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04ef93a-fd')
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69c3266-fd0c-4899-853c-0ce5ce22ab27]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:14:08 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:14:08 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:14:08 user nova-compute[75285]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 (non-flash)
Nov 10 21:14:08 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:14:08 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:14:08 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:14:08 user nova-compute[75285]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 (non-flash)
Nov 10 21:14:08 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e46d6ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581'): ({'sde'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Removing single pathed devices sde {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[43081fbe-5d9a-4f59-a1e7-dc164f7550fd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d23c75-761a-4c0f-b06e-4f16bdffaee1]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Flushing IO for device /dev/sde {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] No VIF found with MAC fa:16:3e:62:ef:29, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c00e57-2514-4ddd-bb2c-584bd6d30cff]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:14:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.072s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8514a415-b3b4-4f02-9c8a-5b19333ec15d]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] SCSI volumes sde have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cce870f-3ff2-4231-85aa-5aa25b44cf7d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[434f9d1e-ef49-4a02-be77-2fe4def4ad65]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581, portal: 172.16.0.220,3260]
Nov 10 21:14:09 user nova-compute[75285]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581, portal: 172.16.0.220,3260] successful.
Nov 10 21:14:09 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbdecc5-51ba-47b4-b898-38e4ea6c4581 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f827db00-d0b8-4e6e-b90f-f36d44792b25]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] <== disconnect_volume: return (405ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:14:09 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Deleting instance files /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c_del
Nov 10 21:14:09 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Deletion of /opt/stack/data/nova/instances/72a39007-63f0-4f1b-8689-286c55ea1d0c_del complete
Nov 10 21:14:09 user nova-compute[75285]: INFO nova.compute.manager [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 10 21:14:09 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG nova.network.neutron [req-9cd0b6d9-dab8-4258-98eb-fa67f3e56632 req-3e18391f-880f-4c2f-a328-0007986183c3 service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updated VIF entry in instance network info cache for port a04ef93a-fdc5-4229-a69a-1b2daf6f5995. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG nova.network.neutron [req-9cd0b6d9-dab8-4258-98eb-fa67f3e56632 req-3e18391f-880f-4c2f-a328-0007986183c3 service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updating instance_info_cache with network_info: [{"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:14:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9cd0b6d9-dab8-4258-98eb-fa67f3e56632 req-3e18391f-880f-4c2f-a328-0007986183c3 service nova] Releasing lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:14:10 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:14:10 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Took 0.87 seconds to deallocate network for instance.
Nov 10 21:14:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-9a342f4c-ab35-4c51-986f-8e1f6affffda req-2a193aca-2ec1-487f-9368-53e1793d4358 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Received event network-vif-deleted-365cab06-6f34-462e-95e8-e2a687de3a45 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:14:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-8613bc0b-4170-491b-921f-76cb296f8897 req-8acc7f54-0ff3-45d7-aad4-cae879853b52 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Received event network-vif-plugged-365cab06-6f34-462e-95e8-e2a687de3a45 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:14:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8613bc0b-4170-491b-921f-76cb296f8897 req-8acc7f54-0ff3-45d7-aad4-cae879853b52 service nova] Acquiring lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8613bc0b-4170-491b-921f-76cb296f8897 req-8acc7f54-0ff3-45d7-aad4-cae879853b52 service nova] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8613bc0b-4170-491b-921f-76cb296f8897 req-8acc7f54-0ff3-45d7-aad4-cae879853b52 service nova] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-8613bc0b-4170-491b-921f-76cb296f8897 req-8acc7f54-0ff3-45d7-aad4-cae879853b52 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] No waiting events found dispatching network-vif-plugged-365cab06-6f34-462e-95e8-e2a687de3a45 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:14:10 user nova-compute[75285]: WARNING nova.compute.manager [req-8613bc0b-4170-491b-921f-76cb296f8897 req-8acc7f54-0ff3-45d7-aad4-cae879853b52 service nova] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Received unexpected event network-vif-plugged-365cab06-6f34-462e-95e8-e2a687de3a45 for instance with vm_state active and task_state deleting.
Nov 10 21:14:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG nova.compute.manager [req-8ec6b7c3-0026-4e16-a1d6-91f99e406c03 req-e0a11301-ac97-488a-970c-1f6812e1491d service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Received event network-vif-plugged-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8ec6b7c3-0026-4e16-a1d6-91f99e406c03 req-e0a11301-ac97-488a-970c-1f6812e1491d service nova] Acquiring lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8ec6b7c3-0026-4e16-a1d6-91f99e406c03 req-e0a11301-ac97-488a-970c-1f6812e1491d service nova] Lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8ec6b7c3-0026-4e16-a1d6-91f99e406c03 req-e0a11301-ac97-488a-970c-1f6812e1491d service nova] Lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG nova.compute.manager [req-8ec6b7c3-0026-4e16-a1d6-91f99e406c03 req-e0a11301-ac97-488a-970c-1f6812e1491d service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] No waiting events found dispatching network-vif-plugged-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:14:12 user nova-compute[75285]: WARNING nova.compute.manager [req-8ec6b7c3-0026-4e16-a1d6-91f99e406c03 req-e0a11301-ac97-488a-970c-1f6812e1491d service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Received unexpected event network-vif-plugged-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 for instance with vm_state building and task_state spawning.
Nov 10 21:14:12 user nova-compute[75285]: DEBUG nova.compute.manager [req-8ec6b7c3-0026-4e16-a1d6-91f99e406c03 req-e0a11301-ac97-488a-970c-1f6812e1491d service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Received event network-vif-plugged-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8ec6b7c3-0026-4e16-a1d6-91f99e406c03 req-e0a11301-ac97-488a-970c-1f6812e1491d service nova] Acquiring lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8ec6b7c3-0026-4e16-a1d6-91f99e406c03 req-e0a11301-ac97-488a-970c-1f6812e1491d service nova] Lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8ec6b7c3-0026-4e16-a1d6-91f99e406c03 req-e0a11301-ac97-488a-970c-1f6812e1491d service nova] Lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG nova.compute.manager [req-8ec6b7c3-0026-4e16-a1d6-91f99e406c03 req-e0a11301-ac97-488a-970c-1f6812e1491d service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] No waiting events found dispatching network-vif-plugged-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:14:12 user nova-compute[75285]: WARNING nova.compute.manager [req-8ec6b7c3-0026-4e16-a1d6-91f99e406c03 req-e0a11301-ac97-488a-970c-1f6812e1491d service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Received unexpected event network-vif-plugged-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 for instance with vm_state building and task_state spawning.
Nov 10 21:14:12 user nova-compute[75285]: DEBUG nova.compute.manager [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:14:12 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Instance spawned successfully.
Nov 10 21:14:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:14:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:14:12 user nova-compute[75285]: INFO nova.compute.manager [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Took 6.65 seconds to spawn the instance on the hypervisor.
Nov 10 21:14:12 user nova-compute[75285]: DEBUG nova.compute.manager [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:14:13 user nova-compute[75285]: INFO nova.compute.manager [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Took 7.83 seconds to build instance.
Nov 10 21:14:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-bcaf54b0-b8e2-4e7e-aa33-70679f2e79a6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "679abba8-40e6-4489-a34f-d4ae6843387b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.compute.manager [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:14:21 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Creating image(s)
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Did not create local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Ensure instance console log exists: /opt/stack/data/nova/instances/278ff84f-a732-4d81-81e5-74df508c9f11/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Start _get_guest_xml network_info=[{"id": "05305385-566b-49c0-a6c0-50fb2b7e9170", "address": "fa:16:3e:b5:0e:61", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05305385-56", "ovs_interfaceid": "05305385-566b-49c0-a6c0-50fb2b7e9170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '83b7337f-629c-4192-97cf-88594e75a3ad', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZFsAejg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '278ff84f-a732-4d81-81e5-74df508c9f11', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa895f68-63cb-4dad-aedf-9ac3c418b57c', 'serial': 'aa895f68-63cb-4dad-aedf-9ac3c418b57c'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:14:21 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:14:21 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZFsAejg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:14:21 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:14:21 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:14:21 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[503e7cc3-042e-42ac-be19-d6dc3214bd2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:14:21 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[259ed6a6-f267-4fa7-8e37-e9a2291f5823]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c] added
Nov 10 21:14:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[566a8cfc-1f7f-464f-9375-235129903789]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[630788c3-b674-4221-8b1b-034a71f4ee55]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZFsAejg {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZFsAejg" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b955dfb4-2317-455a-9446-a9c34b128187]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aZFsAejg'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4403cefc-08be-47f2-a8a4-a2881f9d8578]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2fa826-c138-4448-8ad5-905e6de83994]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:14:21 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:14:21 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:14:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:14:21 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:14:21 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:14:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:21 user nova-compute[75285]: INFO nova.compute.manager [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] [instance: 72a39007-63f0-4f1b-8689-286c55ea1d0c] Took 11.69 seconds to detach 1 volumes for instance.
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8800488-ec4a-4724-8143-79890ee9e827]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260]
Nov 10 21:14:21 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260] successful.
Nov 10 21:14:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ec983b-27ce-4560-b7cf-e96885f22981]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[293a1e4f-cedb-40e1-bd0f-0d19b59576b5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:14:21 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:14:21 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:14:21 user nova-compute[75285]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:14:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:14:21 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:14:21 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:14:21 user nova-compute[75285]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:14:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[da22bdac-b495-45b9-8ace-32e7115dc0e0]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:21 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:14:22 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:14:22 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:14:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:22 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Deleted allocations for instance 72a39007-63f0-4f1b-8689-286c55ea1d0c
Nov 10 21:14:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-07cbebb0-e9fd-4a8b-9dd4-b361fdaa942c tempest-DeleteServersTestJSON-2100112621 tempest-DeleteServersTestJSON-2100112621-project-member] Lock "72a39007-63f0-4f1b-8689-286c55ea1d0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.636s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:22 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:14:22 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZFsAejg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:14:22 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:14:22 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23835636562376139', 'path': '/dev/sde'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:14:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835636562376139', 'path': '/dev/sde'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:14:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:13:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-567390446',display_name='tempest-TestVolumeBootPattern-server-567390446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-567390446',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAAoUPxLI+zueb7o2tu1JS76f604TN+uq+pfg2zYS5MbkMZtx1Ub2kBFu6OB71sTNt8tpmOHljKAgKzRpBKVdyr/VTj1zgWyamAFtpMuzpYAL+WhfMApRgNi/CTwdcWlw==',key_name='tempest-TestVolumeBootPattern-2083573923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04636b8a9e404d40a3a2bc9f63a4df8c',ramdisk_id='',reservation_id='r-lfw1q9yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1962512242',owner_user_name='tempest-TestVolumeBootPattern-1962512242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:13:51Z,user_data=None,user_id='e16c471c0875416aa0eb86d89eef3a27',uuid=278ff84f-a732-4d81-81e5-74df508c9f11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05305385-566b-49c0-a6c0-50fb2b7e9170", "address": "fa:16:3e:b5:0e:61", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05305385-56", "ovs_interfaceid": "05305385-566b-49c0-a6c0-50fb2b7e9170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:14:22 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converting VIF {"id": "05305385-566b-49c0-a6c0-50fb2b7e9170", "address": "fa:16:3e:b5:0e:61", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05305385-56", "ovs_interfaceid": "05305385-566b-49c0-a6c0-50fb2b7e9170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:14:22 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0e:61,bridge_name='br-int',has_traffic_filtering=True,id=05305385-566b-49c0-a6c0-50fb2b7e9170,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05305385-56') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:14:22 user nova-compute[75285]: DEBUG nova.objects.instance [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lazy-loading 'pci_devices' on Instance uuid 278ff84f-a732-4d81-81e5-74df508c9f11 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:14:23 user nova-compute[75285]:   <uuid>278ff84f-a732-4d81-81e5-74df508c9f11</uuid>
Nov 10 21:14:23 user nova-compute[75285]:   <name>instance-00000019</name>
Nov 10 21:14:23 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:14:23 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:14:23 user nova-compute[75285]:   <metadata>
Nov 10 21:14:23 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:14:23 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:14:23 user nova-compute[75285]:       <nova:name>tempest-TestVolumeBootPattern-server-567390446</nova:name>
Nov 10 21:14:23 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:14:21</nova:creationTime>
Nov 10 21:14:23 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:14:23 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:14:23 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:14:23 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:14:23 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:14:23 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:14:23 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:14:23 user nova-compute[75285]:       <nova:owner>
Nov 10 21:14:23 user nova-compute[75285]:         <nova:user uuid="e16c471c0875416aa0eb86d89eef3a27">tempest-TestVolumeBootPattern-1962512242-project-member</nova:user>
Nov 10 21:14:23 user nova-compute[75285]:         <nova:project uuid="04636b8a9e404d40a3a2bc9f63a4df8c">tempest-TestVolumeBootPattern-1962512242</nova:project>
Nov 10 21:14:23 user nova-compute[75285]:       </nova:owner>
Nov 10 21:14:23 user nova-compute[75285]:       <nova:ports>
Nov 10 21:14:23 user nova-compute[75285]:         <nova:port uuid="05305385-566b-49c0-a6c0-50fb2b7e9170">
Nov 10 21:14:23 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 21:14:23 user nova-compute[75285]:         </nova:port>
Nov 10 21:14:23 user nova-compute[75285]:       </nova:ports>
Nov 10 21:14:23 user nova-compute[75285]:     </nova:instance>
Nov 10 21:14:23 user nova-compute[75285]:   </metadata>
Nov 10 21:14:23 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:14:23 user nova-compute[75285]:     <system>
Nov 10 21:14:23 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:14:23 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:14:23 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:14:23 user nova-compute[75285]:       <entry name="serial">278ff84f-a732-4d81-81e5-74df508c9f11</entry>
Nov 10 21:14:23 user nova-compute[75285]:       <entry name="uuid">278ff84f-a732-4d81-81e5-74df508c9f11</entry>
Nov 10 21:14:23 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:14:23 user nova-compute[75285]:     </system>
Nov 10 21:14:23 user nova-compute[75285]:   </sysinfo>
Nov 10 21:14:23 user nova-compute[75285]:   <os>
Nov 10 21:14:23 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:14:23 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:14:23 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:14:23 user nova-compute[75285]:   </os>
Nov 10 21:14:23 user nova-compute[75285]:   <features>
Nov 10 21:14:23 user nova-compute[75285]:     <acpi/>
Nov 10 21:14:23 user nova-compute[75285]:     <apic/>
Nov 10 21:14:23 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:14:23 user nova-compute[75285]:   </features>
Nov 10 21:14:23 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:14:23 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:14:23 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:14:23 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:14:23 user nova-compute[75285]:   </clock>
Nov 10 21:14:23 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:14:23 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:14:23 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:14:23 user nova-compute[75285]:   </cpu>
Nov 10 21:14:23 user nova-compute[75285]:   <devices>
Nov 10 21:14:23 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:14:23 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:14:23 user nova-compute[75285]:       <source dev="/dev/sde"/>
Nov 10 21:14:23 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:14:23 user nova-compute[75285]:       <serial>aa895f68-63cb-4dad-aedf-9ac3c418b57c</serial>
Nov 10 21:14:23 user nova-compute[75285]:     </disk>
Nov 10 21:14:23 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:14:23 user nova-compute[75285]:       <mac address="fa:16:3e:b5:0e:61"/>
Nov 10 21:14:23 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:14:23 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:14:23 user nova-compute[75285]:       <target dev="tap05305385-56"/>
Nov 10 21:14:23 user nova-compute[75285]:     </interface>
Nov 10 21:14:23 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:14:23 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/278ff84f-a732-4d81-81e5-74df508c9f11/console.log" append="off"/>
Nov 10 21:14:23 user nova-compute[75285]:     </serial>
Nov 10 21:14:23 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:14:23 user nova-compute[75285]:     <video>
Nov 10 21:14:23 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:14:23 user nova-compute[75285]:     </video>
Nov 10 21:14:23 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:14:23 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:14:23 user nova-compute[75285]:     </rng>
Nov 10 21:14:23 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:14:23 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:14:23 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:14:23 user nova-compute[75285]:     </memballoon>
Nov 10 21:14:23 user nova-compute[75285]:   </devices>
Nov 10 21:14:23 user nova-compute[75285]: </domain>
Nov 10 21:14:23 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:13:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-567390446',display_name='tempest-TestVolumeBootPattern-server-567390446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-567390446',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAAoUPxLI+zueb7o2tu1JS76f604TN+uq+pfg2zYS5MbkMZtx1Ub2kBFu6OB71sTNt8tpmOHljKAgKzRpBKVdyr/VTj1zgWyamAFtpMuzpYAL+WhfMApRgNi/CTwdcWlw==',key_name='tempest-TestVolumeBootPattern-2083573923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04636b8a9e404d40a3a2bc9f63a4df8c',ramdisk_id='',reservation_id='r-lfw1q9yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1962512242',owner_user_name='tempest-TestVolumeBootPattern-1962512242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:13:51Z,user_data=None,user_id='e16c471c0875416aa0eb86d89eef3a27',uuid=278ff84f-a732-4d81-81e5-74df508c9f11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05305385-566b-49c0-a6c0-50fb2b7e9170", "address": "fa:16:3e:b5:0e:61", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05305385-56", "ovs_interfaceid": "05305385-566b-49c0-a6c0-50fb2b7e9170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converting VIF {"id": "05305385-566b-49c0-a6c0-50fb2b7e9170", "address": "fa:16:3e:b5:0e:61", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05305385-56", "ovs_interfaceid": "05305385-566b-49c0-a6c0-50fb2b7e9170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0e:61,bridge_name='br-int',has_traffic_filtering=True,id=05305385-566b-49c0-a6c0-50fb2b7e9170,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05305385-56') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG os_vif [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0e:61,bridge_name='br-int',has_traffic_filtering=True,id=05305385-566b-49c0-a6c0-50fb2b7e9170,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05305385-56') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8fc6e9e-1257-52bd-ac9a-f04b1aa5fc97', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05305385-56, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05305385-56, col_values=(('qos', UUID('50dedf14-2d77-4abd-b987-fcd41fae9c60')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05305385-56, col_values=(('external_ids', {'iface-id': '05305385-566b-49c0-a6c0-50fb2b7e9170', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:0e:61', 'vm-uuid': '278ff84f-a732-4d81-81e5-74df508c9f11'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:23 user nova-compute[75285]: INFO os_vif [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0e:61,bridge_name='br-int',has_traffic_filtering=True,id=05305385-566b-49c0-a6c0-50fb2b7e9170,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05305385-56')
Nov 10 21:14:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:14:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] No VIF found with MAC fa:16:3e:b5:0e:61, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:14:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-fd622384-5126-468c-9c9f-077f5e94f9c6 req-f373626a-7a96-4e2a-8e2d-acbcc3d55dea service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Received event network-vif-plugged-05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:14:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fd622384-5126-468c-9c9f-077f5e94f9c6 req-f373626a-7a96-4e2a-8e2d-acbcc3d55dea service nova] Acquiring lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fd622384-5126-468c-9c9f-077f5e94f9c6 req-f373626a-7a96-4e2a-8e2d-acbcc3d55dea service nova] Lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fd622384-5126-468c-9c9f-077f5e94f9c6 req-f373626a-7a96-4e2a-8e2d-acbcc3d55dea service nova] Lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-fd622384-5126-468c-9c9f-077f5e94f9c6 req-f373626a-7a96-4e2a-8e2d-acbcc3d55dea service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] No waiting events found dispatching network-vif-plugged-05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:14:24 user nova-compute[75285]: WARNING nova.compute.manager [req-fd622384-5126-468c-9c9f-077f5e94f9c6 req-f373626a-7a96-4e2a-8e2d-acbcc3d55dea service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Received unexpected event network-vif-plugged-05305385-566b-49c0-a6c0-50fb2b7e9170 for instance with vm_state building and task_state spawning.
Nov 10 21:14:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:26 user nova-compute[75285]: DEBUG nova.compute.manager [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:14:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:14:26 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Instance spawned successfully.
Nov 10 21:14:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:14:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:14:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:14:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:14:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:14:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:14:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:14:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-4df374c3-06c7-44f4-a113-a9137d7b4898 req-690bbb4f-c2d1-4262-9818-7686d7b9b402 service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Received event network-vif-plugged-05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:14:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4df374c3-06c7-44f4-a113-a9137d7b4898 req-690bbb4f-c2d1-4262-9818-7686d7b9b402 service nova] Acquiring lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4df374c3-06c7-44f4-a113-a9137d7b4898 req-690bbb4f-c2d1-4262-9818-7686d7b9b402 service nova] Lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4df374c3-06c7-44f4-a113-a9137d7b4898 req-690bbb4f-c2d1-4262-9818-7686d7b9b402 service nova] Lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-4df374c3-06c7-44f4-a113-a9137d7b4898 req-690bbb4f-c2d1-4262-9818-7686d7b9b402 service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] No waiting events found dispatching network-vif-plugged-05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:14:26 user nova-compute[75285]: WARNING nova.compute.manager [req-4df374c3-06c7-44f4-a113-a9137d7b4898 req-690bbb4f-c2d1-4262-9818-7686d7b9b402 service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Received unexpected event network-vif-plugged-05305385-566b-49c0-a6c0-50fb2b7e9170 for instance with vm_state building and task_state spawning.
Nov 10 21:14:26 user nova-compute[75285]: INFO nova.compute.manager [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 10 21:14:26 user nova-compute[75285]: DEBUG nova.compute.manager [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:14:26 user nova-compute[75285]: INFO nova.compute.manager [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Took 37.39 seconds to build instance.
Nov 10 21:14:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0fedce95-82c8-4b79-bad3-8ecc41832ae6 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "278ff84f-a732-4d81-81e5-74df508c9f11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.586s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:33 user nova-compute[75285]: INFO nova.compute.manager [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Rescuing
Nov 10 21:14:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:14:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquired lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:14:33 user nova-compute[75285]: DEBUG nova.network.neutron [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:14:33 user nova-compute[75285]: DEBUG nova.network.neutron [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Updating instance_info_cache with network_info: [{"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:14:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Releasing lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-4dccf2f7-a1b8-40d8-bcfc-e95315fe974f req-c267e0a3-54a4-4018-8385-03c9a00e695a service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-unplugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4dccf2f7-a1b8-40d8-bcfc-e95315fe974f req-c267e0a3-54a4-4018-8385-03c9a00e695a service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4dccf2f7-a1b8-40d8-bcfc-e95315fe974f req-c267e0a3-54a4-4018-8385-03c9a00e695a service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4dccf2f7-a1b8-40d8-bcfc-e95315fe974f req-c267e0a3-54a4-4018-8385-03c9a00e695a service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-4dccf2f7-a1b8-40d8-bcfc-e95315fe974f req-c267e0a3-54a4-4018-8385-03c9a00e695a service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-unplugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:14:34 user nova-compute[75285]: WARNING nova.compute.manager [req-4dccf2f7-a1b8-40d8-bcfc-e95315fe974f req-c267e0a3-54a4-4018-8385-03c9a00e695a service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-unplugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state active and task_state rescuing.
Nov 10 21:14:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Instance destroyed successfully.
Nov 10 21:14:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Attempting a stable device rescue
Nov 10 21:14:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75285) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Instance directory exists: not creating {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 21:14:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Creating image(s)
Nov 10 21:14:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "/opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "/opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG nova.objects.instance [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'trusted_certs' on Instance uuid ac0ddf13-9584-4e5d-99be-ad8feb6c532f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "b28a38d386d2b0e7182a9653cc69f7d18fe6483f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "b28a38d386d2b0e7182a9653cc69f7d18fe6483f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f.part --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f.part --force-share --output=json" returned: 0 in 0.223s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG nova.virt.images [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] d39e4785-e305-4dc0-8efa-c25449e8e34f was qcow2, converting to raw {{(pid=75285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f.part /opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f.converted {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f.part /opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f.converted" returned: 0 in 0.398s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f.converted --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-2687e482-2725-47e7-ad08-93cc9a540b78 req-f1e9c8c7-a9fd-4891-b0f8-b7e4b1dddc14 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2687e482-2725-47e7-ad08-93cc9a540b78 req-f1e9c8c7-a9fd-4891-b0f8-b7e4b1dddc14 service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2687e482-2725-47e7-ad08-93cc9a540b78 req-f1e9c8c7-a9fd-4891-b0f8-b7e4b1dddc14 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2687e482-2725-47e7-ad08-93cc9a540b78 req-f1e9c8c7-a9fd-4891-b0f8-b7e4b1dddc14 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-2687e482-2725-47e7-ad08-93cc9a540b78 req-f1e9c8c7-a9fd-4891-b0f8-b7e4b1dddc14 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:14:36 user nova-compute[75285]: WARNING nova.compute.manager [req-2687e482-2725-47e7-ad08-93cc9a540b78 req-f1e9c8c7-a9fd-4891-b0f8-b7e4b1dddc14 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state active and task_state rescuing.
Nov 10 21:14:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "b28a38d386d2b0e7182a9653cc69f7d18fe6483f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.932s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "b28a38d386d2b0e7182a9653cc69f7d18fe6483f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "b28a38d386d2b0e7182a9653cc69f7d18fe6483f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f,backing_fmt=raw /opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/disk.rescue {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f,backing_fmt=raw /opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/disk.rescue" returned: 0 in 0.049s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "b28a38d386d2b0e7182a9653cc69f7d18fe6483f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.objects.instance [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'migration_context' on Instance uuid ac0ddf13-9584-4e5d-99be-ad8feb6c532f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.objects.base [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Object Instance<ac0ddf13-9584-4e5d-99be-ad8feb6c532f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Start _get_guest_xml network_info=[{"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "vif_mac": "fa:16:3e:6d:a1:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd39e4785-e305-4dc0-8efa-c25449e8e34f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'c5dc060a-e8ca-4c81-958e-a1dc40bf2c0b', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmHUkxpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'ac0ddf13-9584-4e5d-99be-ad8feb6c532f', 'attached_at': '', 'detached_at': '', 'volume_id': '8ad68515-50bc-444d-adf3-8552e9192868', 'serial': '8ad68515-50bc-444d-adf3-8552e9192868'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.objects.instance [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'resources' on Instance uuid ac0ddf13-9584-4e5d-99be-ad8feb6c532f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.objects.base [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Object Instance<ac0ddf13-9584-4e5d-99be-ad8feb6c532f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.objects.instance [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'numa_topology' on Instance uuid ac0ddf13-9584-4e5d-99be-ad8feb6c532f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.objects.base [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Object Instance<ac0ddf13-9584-4e5d-99be-ad8feb6c532f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:14:37 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:14:37 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.objects.instance [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'vcpu_model' on Instance uuid ac0ddf13-9584-4e5d-99be-ad8feb6c532f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.objects.base [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Object Instance<ac0ddf13-9584-4e5d-99be-ad8feb6c532f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmHUkxpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:14:37 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:14:37 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:14:37 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81f758a-2496-40d3-b44c-428769c7e22a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = OmHUkxpu\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 21:14:37 user nova-compute[75285]: node.name = iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:14:37 user nova-compute[75285]: node.tpgt = -1
Nov 10 21:14:37 user nova-compute[75285]: node.startup = automatic
Nov 10 21:14:37 user nova-compute[75285]: node.leading_login = No
Nov 10 21:14:37 user nova-compute[75285]: iface.iscsi_ifacename = default
Nov 10 21:14:37 user nova-compute[75285]: iface.net_ifacename = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.ipaddress = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.prefix_len = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.hwaddress = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.transport_name = tcp
Nov 10 21:14:37 user nova-compute[75285]: iface.initiatorname = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.state = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.vlan_id = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.vlan_priority = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.vlan_state = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.iface_num = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.mtu = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.port = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.bootproto = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.subnet_mask = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.gateway = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.dhcp_alt_client_id = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.dhcp_dns = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.dhcp_learn_iqn = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.dhcp_vendor_id_state = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.dhcp_vendor_id = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.dhcp_slp_da = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.fragmentation = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.gratuitous_arp = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.incoming_forwarding = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.tos_state = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.tos = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.ttl = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.delayed_ack = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.tcp_nagle = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.tcp_wsf_state = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.tcp_wsf = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.tcp_timer_scale = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.tcp_timestamp = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.redirect = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.def_task_mgmt_timeout = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.header_digest = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.data_digest = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.immediate_data = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.initial_r2t = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.data_seq_inorder = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.data_pdu_inorder = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.erl = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.max_receive_data_len = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.first_burst_len = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.max_outstanding_r2t = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.max_burst_len = 0
Nov 10 21:14:37 user nova-compute[75285]: iface.chap_auth = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.bidi_chap = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.strict_login_compliance = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.discovery_auth = <empty>
Nov 10 21:14:37 user nova-compute[75285]: iface.discovery_logout = <empty>
Nov 10 21:14:37 user nova-compute[75285]: node.discovery_address = <empty>
Nov 10 21:14:37 user nova-compute[75285]: node.discovery_port = 0
Nov 10 21:14:37 user nova-compute[75285]: node.discovery_type = static
Nov 10 21:14:37 user nova-compute[75285]: node.session.initial_cmdsn = 0
Nov 10 21:14:37 user nova-compute[75285]: node.session.initial_login_retry_max = 8
Nov 10 21:14:37 user nova-compute[75285]: node.session.xmit_thread_priority = -20
Nov 10 21:14:37 user nova-compute[75285]: node.session.cmds_max = 128
Nov 10 21:14:37 user nova-compute[75285]: node.session.queue_depth = 32
Nov 10 21:14:37 user nova-compute[75285]: node.session.nr_sessions = 1
Nov 10 21:14:37 user nova-compute[75285]: node.session.auth.authmethod = CHAP
Nov 10 21:14:37 user nova-compute[75285]: node.session.auth.username = OmHUkxpu
Nov 10 21:14:37 user nova-compute[75285]: node.session.auth.password = ***
Nov 10 21:14:37 user nova-compute[75285]: node.session.auth.username_in = <empty>
Nov 10 21:14:37 user nova-compute[75285]: node.session.auth.password_in = <empty>
Nov 10 21:14:37 user nova-compute[75285]: node.session.auth.chap_algs = MD5
Nov 10 21:14:37 user nova-compute[75285]: node.session.timeo.replacement_timeout = 120
Nov 10 21:14:37 user nova-compute[75285]: node.session.err_timeo.abort_timeout = 15
Nov 10 21:14:37 user nova-compute[75285]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 21:14:37 user nova-compute[75285]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 21:14:37 user nova-compute[75285]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 21:14:37 user nova-compute[75285]: node.session.iscsi.FastAbort = Yes
Nov 10 21:14:37 user nova-compute[75285]: node.session.iscsi.InitialR2T = No
Nov 10 21:14:37 user nova-compute[75285]: node.session.iscsi.ImmediateData = Yes
Nov 10 21:14:37 user nova-compute[75285]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 21:14:37 user nova-compute[75285]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 21:14:37 user nova-compute[75285]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 21:14:37 user nova-compute[75285]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 21:14:37 user nova-compute[75285]: node.session.iscsi.MaxConnections = 1
Nov 10 21:14:37 user nova-compute[75285]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 21:14:37 user nova-compute[75285]: node.session.iscsi.ERL = 0
Nov 10 21:14:37 user nova-compute[75285]: node.session.scan = manual
Nov 10 21:14:37 user nova-compute[75285]: node.session.reopen_max = 0
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].address = 172.16.0.220
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].port = 3260
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].startup = manual
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].tcp.window_size = 524288
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].tcp.type_of_service = 0
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].timeo.logout_timeout = 15
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].timeo.login_timeout = 15
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].timeo.auth_timeout = 45
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].iscsi.DataDigest = None
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].iscsi.IFMarker = No
Nov 10 21:14:37 user nova-compute[75285]: node.conn[0].iscsi.OFMarker = No
Nov 10 21:14:37 user nova-compute[75285]: # END RECORD
Nov 10 21:14:37 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae933e1a-311f-44cd-b753-0864cdf97b7d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ee4b5b-3615-46f7-ba50-444589152292]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmHUkxpu {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmHUkxpu" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a3ee38-2e6b-47bb-bc99-25aad2ed663e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OmHUkxpu'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da978d7-a6bc-4e53-a757-c908031daeef]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed92808-afba-4195-8893-244a06420323]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:14:37 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:14:37 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:14:37 user nova-compute[75285]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:14:37 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:14:37 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:14:37 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:14:37 user nova-compute[75285]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:14:37 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.173s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] HCTL ('34', '0', '0', 0) found on session 20 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5989565a-849a-4634-af9e-86621b22d00d]: (4, ('0 0 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching for a device in session 20 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmHUkxpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.200s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] <== connect_volume: return (201ms) {'type': 'block', 'scsi_wwn': '26161633366663564', 'path': '/dev/sdc'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161633366663564', 'path': '/dev/sdc'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1163902995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1163902995',id=24,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:13:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9957f55c59044088e94338564e04092',ramdisk_id='',reservation_id='r-5x066zft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-396261753',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:13:27Z,user_data=None,user_id='ac13c724170f47368e5a395110c631b7',uuid=ac0ddf13-9584-4e5d-99be-ad8feb6c532f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "vif_mac": "fa:16:3e:6d:a1:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converting VIF {"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "vif_mac": "fa:16:3e:6d:a1:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:a1:72,bridge_name='br-int',has_traffic_filtering=True,id=0e6fef20-7528-4441-9e5d-6d81d4fd10a3,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6fef20-75') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.objects.instance [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'pci_devices' on Instance uuid ac0ddf13-9584-4e5d-99be-ad8feb6c532f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.objects.base [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Object Instance<ac0ddf13-9584-4e5d-99be-ad8feb6c532f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:14:37 user nova-compute[75285]:   <uuid>ac0ddf13-9584-4e5d-99be-ad8feb6c532f</uuid>
Nov 10 21:14:37 user nova-compute[75285]:   <name>instance-00000018</name>
Nov 10 21:14:37 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:14:37 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:14:37 user nova-compute[75285]:   <metadata>
Nov 10 21:14:37 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:14:37 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:14:37 user nova-compute[75285]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1163902995</nova:name>
Nov 10 21:14:37 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:14:37</nova:creationTime>
Nov 10 21:14:37 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:14:37 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:14:37 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:14:37 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:14:37 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:14:37 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:14:37 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:14:37 user nova-compute[75285]:       <nova:owner>
Nov 10 21:14:37 user nova-compute[75285]:         <nova:user uuid="ac13c724170f47368e5a395110c631b7">tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member</nova:user>
Nov 10 21:14:37 user nova-compute[75285]:         <nova:project uuid="b9957f55c59044088e94338564e04092">tempest-ServerBootFromVolumeStableRescueTest-396261753</nova:project>
Nov 10 21:14:37 user nova-compute[75285]:       </nova:owner>
Nov 10 21:14:37 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:14:37 user nova-compute[75285]:       <nova:ports>
Nov 10 21:14:37 user nova-compute[75285]:         <nova:port uuid="0e6fef20-7528-4441-9e5d-6d81d4fd10a3">
Nov 10 21:14:37 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 21:14:37 user nova-compute[75285]:         </nova:port>
Nov 10 21:14:37 user nova-compute[75285]:       </nova:ports>
Nov 10 21:14:37 user nova-compute[75285]:     </nova:instance>
Nov 10 21:14:37 user nova-compute[75285]:   </metadata>
Nov 10 21:14:37 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:14:37 user nova-compute[75285]:     <system>
Nov 10 21:14:37 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:14:37 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:14:37 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:14:37 user nova-compute[75285]:       <entry name="serial">ac0ddf13-9584-4e5d-99be-ad8feb6c532f</entry>
Nov 10 21:14:37 user nova-compute[75285]:       <entry name="uuid">ac0ddf13-9584-4e5d-99be-ad8feb6c532f</entry>
Nov 10 21:14:37 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:14:37 user nova-compute[75285]:     </system>
Nov 10 21:14:37 user nova-compute[75285]:   </sysinfo>
Nov 10 21:14:37 user nova-compute[75285]:   <os>
Nov 10 21:14:37 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:14:37 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:14:37 user nova-compute[75285]:   </os>
Nov 10 21:14:37 user nova-compute[75285]:   <features>
Nov 10 21:14:37 user nova-compute[75285]:     <acpi/>
Nov 10 21:14:37 user nova-compute[75285]:     <apic/>
Nov 10 21:14:37 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:14:37 user nova-compute[75285]:   </features>
Nov 10 21:14:37 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:14:37 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:14:37 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:14:37 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:14:37 user nova-compute[75285]:   </clock>
Nov 10 21:14:37 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:14:37 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:14:37 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:14:37 user nova-compute[75285]:   </cpu>
Nov 10 21:14:37 user nova-compute[75285]:   <devices>
Nov 10 21:14:37 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:14:37 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:14:37 user nova-compute[75285]:       <source dev="/dev/sdc"/>
Nov 10 21:14:37 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:14:37 user nova-compute[75285]:       <serial>8ad68515-50bc-444d-adf3-8552e9192868</serial>
Nov 10 21:14:37 user nova-compute[75285]:     </disk>
Nov 10 21:14:37 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:14:37 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:14:37 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/disk.rescue"/>
Nov 10 21:14:37 user nova-compute[75285]:       <target dev="vdb" bus="virtio"/>
Nov 10 21:14:37 user nova-compute[75285]:       <boot order="1"/>
Nov 10 21:14:37 user nova-compute[75285]:     </disk>
Nov 10 21:14:37 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:14:37 user nova-compute[75285]:       <mac address="fa:16:3e:6d:a1:72"/>
Nov 10 21:14:37 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:14:37 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:14:37 user nova-compute[75285]:       <target dev="tap0e6fef20-75"/>
Nov 10 21:14:37 user nova-compute[75285]:     </interface>
Nov 10 21:14:37 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:14:37 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/console.log" append="off"/>
Nov 10 21:14:37 user nova-compute[75285]:     </serial>
Nov 10 21:14:37 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:14:37 user nova-compute[75285]:     <video>
Nov 10 21:14:37 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:14:37 user nova-compute[75285]:     </video>
Nov 10 21:14:37 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:14:37 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:14:37 user nova-compute[75285]:     </rng>
Nov 10 21:14:37 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:14:37 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:14:37 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:14:37 user nova-compute[75285]:     </memballoon>
Nov 10 21:14:37 user nova-compute[75285]:   </devices>
Nov 10 21:14:37 user nova-compute[75285]: </domain>
Nov 10 21:14:37 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:14:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Instance destroyed successfully.
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:14:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] No VIF found with MAC fa:16:3e:6d:a1:72, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:14:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-e6786d0b-e206-4975-beda-d272e4a45117 req-9e2a8491-75a5-4f9d-941c-f3981133f5a0 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:14:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e6786d0b-e206-4975-beda-d272e4a45117 req-9e2a8491-75a5-4f9d-941c-f3981133f5a0 service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e6786d0b-e206-4975-beda-d272e4a45117 req-9e2a8491-75a5-4f9d-941c-f3981133f5a0 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e6786d0b-e206-4975-beda-d272e4a45117 req-9e2a8491-75a5-4f9d-941c-f3981133f5a0 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-e6786d0b-e206-4975-beda-d272e4a45117 req-9e2a8491-75a5-4f9d-941c-f3981133f5a0 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:14:39 user nova-compute[75285]: WARNING nova.compute.manager [req-e6786d0b-e206-4975-beda-d272e4a45117 req-9e2a8491-75a5-4f9d-941c-f3981133f5a0 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state active and task_state rescuing.
Nov 10 21:14:39 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:14:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-fe8a17eb-bbd3-4e62-bfe1-7ffec98e49ef tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:14:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-d98c7c5d-aa6a-4462-9bdb-6001783e1fad req-16875af1-5eef-4618-b787-f450ea2f4b6c service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:14:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d98c7c5d-aa6a-4462-9bdb-6001783e1fad req-16875af1-5eef-4618-b787-f450ea2f4b6c service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d98c7c5d-aa6a-4462-9bdb-6001783e1fad req-16875af1-5eef-4618-b787-f450ea2f4b6c service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d98c7c5d-aa6a-4462-9bdb-6001783e1fad req-16875af1-5eef-4618-b787-f450ea2f4b6c service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-d98c7c5d-aa6a-4462-9bdb-6001783e1fad req-16875af1-5eef-4618-b787-f450ea2f4b6c service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:14:41 user nova-compute[75285]: WARNING nova.compute.manager [req-d98c7c5d-aa6a-4462-9bdb-6001783e1fad req-16875af1-5eef-4618-b787-f450ea2f4b6c service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state rescued and task_state None.
Nov 10 21:14:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:43 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:14:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:14:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:14:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:14:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:14:43 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:14:43 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid 16f56b6b-f08d-4650-b0eb-a202662b0eb6 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:14:44 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Updating instance_info_cache with network_info: [{"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:14:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-16f56b6b-f08d-4650-b0eb-a202662b0eb6" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:14:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:14:44 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:14:44 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:14:44 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:14:44 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:14:44 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:14:45 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:14:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:14:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:14:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:14:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:14:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:14:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:14:49 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:14:50 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:14:50 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7706MB free_disk=25.01978302001953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 09ab2e54-1189-420e-9e5c-d158e4106ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3a0c67ef-1414-47e0-8769-c9164baf8993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 0ad7b009-e56f-48ae-8643-29abadf283a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 278ff84f-a732-4d81-81e5-74df508c9f11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:14:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:14:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:51 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:14:51 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:14:51 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:14:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:14:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:15:10 user nova-compute[75285]: INFO nova.compute.claims [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Claim successful on node user
Nov 10 21:15:10 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:15:10 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:15:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG nova.policy [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15813044958a4b52866c3273903d12db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61b6bd18de14243b858764031ccd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:15:10 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Creating image(s)
Nov 10 21:15:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "/opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "/opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "/opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.211s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk 1073741824" returned: 0 in 0.049s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Successfully created port: 5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.204s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Cannot resize image /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Ensure instance console log exists: /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:12 user nova-compute[75285]: INFO nova.compute.manager [None req-2b99785a-d8ec-4942-9487-7c87e2404919 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Unrescuing
Nov 10 21:15:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2b99785a-d8ec-4942-9487-7c87e2404919 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:15:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2b99785a-d8ec-4942-9487-7c87e2404919 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquired lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:15:12 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2b99785a-d8ec-4942-9487-7c87e2404919 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:15:12 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Successfully updated port: 5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:15:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "refresh_cache-55399569-7ba7-4e75-9ded-1e9d6a7832d3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:15:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquired lock "refresh_cache-55399569-7ba7-4e75-9ded-1e9d6a7832d3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:15:12 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:15:12 user nova-compute[75285]: DEBUG nova.compute.manager [req-af280450-f860-469a-9e3d-8d64cab6bcd4 req-41b6326c-f7c7-49ed-98e0-77ab20ba40fd service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Received event network-changed-5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:12 user nova-compute[75285]: DEBUG nova.compute.manager [req-af280450-f860-469a-9e3d-8d64cab6bcd4 req-41b6326c-f7c7-49ed-98e0-77ab20ba40fd service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Refreshing instance network info cache due to event network-changed-5a6b57ea-fb79-4587-a514-43ffa86697b2. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:15:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-af280450-f860-469a-9e3d-8d64cab6bcd4 req-41b6326c-f7c7-49ed-98e0-77ab20ba40fd service nova] Acquiring lock "refresh_cache-55399569-7ba7-4e75-9ded-1e9d6a7832d3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:15:12 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2b99785a-d8ec-4942-9487-7c87e2404919 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updating instance_info_cache with network_info: [{"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2b99785a-d8ec-4942-9487-7c87e2404919 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Releasing lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2b99785a-d8ec-4942-9487-7c87e2404919 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lazy-loading 'flavor' on Instance uuid 09ab2e54-1189-420e-9e5c-d158e4106ffd {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.network.neutron [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Updating instance_info_cache with network_info: [{"id": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "address": "fa:16:3e:bf:71:70", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6b57ea-fb", "ovs_interfaceid": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Releasing lock "refresh_cache-55399569-7ba7-4e75-9ded-1e9d6a7832d3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Instance network_info: |[{"id": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "address": "fa:16:3e:bf:71:70", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6b57ea-fb", "ovs_interfaceid": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-af280450-f860-469a-9e3d-8d64cab6bcd4 req-41b6326c-f7c7-49ed-98e0-77ab20ba40fd service nova] Acquired lock "refresh_cache-55399569-7ba7-4e75-9ded-1e9d6a7832d3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.network.neutron [req-af280450-f860-469a-9e3d-8d64cab6bcd4 req-41b6326c-f7c7-49ed-98e0-77ab20ba40fd service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Refreshing network info cache for port 5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Start _get_guest_xml network_info=[{"id": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "address": "fa:16:3e:bf:71:70", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6b57ea-fb", "ovs_interfaceid": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:15:13 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:15:13 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1276661455',display_name='tempest-VolumesSnapshotTestJSON-instance-1276661455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1276661455',id=27,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZC1cFvaF2TRHwvd9aoZtEONnqdw0HARFQyQxicwSOsEZsbCoKb2Wq3HRphD9id0QW2eGqr2vUO8cc2JnXrokyErX1XxoPAuzNi685jWO3RNuCUtmhwypZrFeHAk2Pyfw==',key_name='tempest-keypair-2134104118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b61b6bd18de14243b858764031ccd52b',ramdisk_id='',reservation_id='r-996165r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1530341723',owner_user_name='tempest-VolumesSnapshotTestJSON-1530341723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:15:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15813044958a4b52866c3273903d12db',uuid=55399569-7ba7-4e75-9ded-1e9d6a7832d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "address": "fa:16:3e:bf:71:70", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6b57ea-fb", "ovs_interfaceid": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Converting VIF {"id": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "address": "fa:16:3e:bf:71:70", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6b57ea-fb", "ovs_interfaceid": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:71:70,bridge_name='br-int',has_traffic_filtering=True,id=5a6b57ea-fb79-4587-a514-43ffa86697b2,network=Network(310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6b57ea-fb') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.objects.instance [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lazy-loading 'pci_devices' on Instance uuid 55399569-7ba7-4e75-9ded-1e9d6a7832d3 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:15:13 user nova-compute[75285]:   <uuid>55399569-7ba7-4e75-9ded-1e9d6a7832d3</uuid>
Nov 10 21:15:13 user nova-compute[75285]:   <name>instance-0000001b</name>
Nov 10 21:15:13 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:15:13 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:15:13 user nova-compute[75285]:   <metadata>
Nov 10 21:15:13 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:15:13 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:15:13 user nova-compute[75285]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1276661455</nova:name>
Nov 10 21:15:13 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:15:13</nova:creationTime>
Nov 10 21:15:13 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:15:13 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:15:13 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:15:13 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:15:13 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:15:13 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:15:13 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:15:13 user nova-compute[75285]:       <nova:owner>
Nov 10 21:15:13 user nova-compute[75285]:         <nova:user uuid="15813044958a4b52866c3273903d12db">tempest-VolumesSnapshotTestJSON-1530341723-project-member</nova:user>
Nov 10 21:15:13 user nova-compute[75285]:         <nova:project uuid="b61b6bd18de14243b858764031ccd52b">tempest-VolumesSnapshotTestJSON-1530341723</nova:project>
Nov 10 21:15:13 user nova-compute[75285]:       </nova:owner>
Nov 10 21:15:13 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:15:13 user nova-compute[75285]:       <nova:ports>
Nov 10 21:15:13 user nova-compute[75285]:         <nova:port uuid="5a6b57ea-fb79-4587-a514-43ffa86697b2">
Nov 10 21:15:13 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 21:15:13 user nova-compute[75285]:         </nova:port>
Nov 10 21:15:13 user nova-compute[75285]:       </nova:ports>
Nov 10 21:15:13 user nova-compute[75285]:     </nova:instance>
Nov 10 21:15:13 user nova-compute[75285]:   </metadata>
Nov 10 21:15:13 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:15:13 user nova-compute[75285]:     <system>
Nov 10 21:15:13 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:15:13 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:15:13 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:15:13 user nova-compute[75285]:       <entry name="serial">55399569-7ba7-4e75-9ded-1e9d6a7832d3</entry>
Nov 10 21:15:13 user nova-compute[75285]:       <entry name="uuid">55399569-7ba7-4e75-9ded-1e9d6a7832d3</entry>
Nov 10 21:15:13 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:15:13 user nova-compute[75285]:     </system>
Nov 10 21:15:13 user nova-compute[75285]:   </sysinfo>
Nov 10 21:15:13 user nova-compute[75285]:   <os>
Nov 10 21:15:13 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:15:13 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:15:13 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:15:13 user nova-compute[75285]:   </os>
Nov 10 21:15:13 user nova-compute[75285]:   <features>
Nov 10 21:15:13 user nova-compute[75285]:     <acpi/>
Nov 10 21:15:13 user nova-compute[75285]:     <apic/>
Nov 10 21:15:13 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:15:13 user nova-compute[75285]:   </features>
Nov 10 21:15:13 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:15:13 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:15:13 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:15:13 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:15:13 user nova-compute[75285]:   </clock>
Nov 10 21:15:13 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:15:13 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:15:13 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:15:13 user nova-compute[75285]:   </cpu>
Nov 10 21:15:13 user nova-compute[75285]:   <devices>
Nov 10 21:15:13 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:15:13 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:15:13 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk"/>
Nov 10 21:15:13 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:15:13 user nova-compute[75285]:     </disk>
Nov 10 21:15:13 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:15:13 user nova-compute[75285]:       <mac address="fa:16:3e:bf:71:70"/>
Nov 10 21:15:13 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:15:13 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:15:13 user nova-compute[75285]:       <target dev="tap5a6b57ea-fb"/>
Nov 10 21:15:13 user nova-compute[75285]:     </interface>
Nov 10 21:15:13 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:15:13 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/console.log" append="off"/>
Nov 10 21:15:13 user nova-compute[75285]:     </serial>
Nov 10 21:15:13 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:15:13 user nova-compute[75285]:     <video>
Nov 10 21:15:13 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:15:13 user nova-compute[75285]:     </video>
Nov 10 21:15:13 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:15:13 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:15:13 user nova-compute[75285]:     </rng>
Nov 10 21:15:13 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:15:13 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:15:13 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:15:13 user nova-compute[75285]:     </memballoon>
Nov 10 21:15:13 user nova-compute[75285]:   </devices>
Nov 10 21:15:13 user nova-compute[75285]: </domain>
Nov 10 21:15:13 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1276661455',display_name='tempest-VolumesSnapshotTestJSON-instance-1276661455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1276661455',id=27,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZC1cFvaF2TRHwvd9aoZtEONnqdw0HARFQyQxicwSOsEZsbCoKb2Wq3HRphD9id0QW2eGqr2vUO8cc2JnXrokyErX1XxoPAuzNi685jWO3RNuCUtmhwypZrFeHAk2Pyfw==',key_name='tempest-keypair-2134104118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b61b6bd18de14243b858764031ccd52b',ramdisk_id='',reservation_id='r-996165r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1530341723',owner_user_name='tempest-VolumesSnapshotTestJSON-1530341723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:15:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15813044958a4b52866c3273903d12db',uuid=55399569-7ba7-4e75-9ded-1e9d6a7832d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "address": "fa:16:3e:bf:71:70", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6b57ea-fb", "ovs_interfaceid": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Converting VIF {"id": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "address": "fa:16:3e:bf:71:70", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6b57ea-fb", "ovs_interfaceid": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:71:70,bridge_name='br-int',has_traffic_filtering=True,id=5a6b57ea-fb79-4587-a514-43ffa86697b2,network=Network(310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6b57ea-fb') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG os_vif [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:71:70,bridge_name='br-int',has_traffic_filtering=True,id=5a6b57ea-fb79-4587-a514-43ffa86697b2,network=Network(310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6b57ea-fb') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3973503c-624a-501f-9c65-f0753c380226', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a6b57ea-fb, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a6b57ea-fb, col_values=(('qos', UUID('d7d99310-8377-4e0d-85e0-326c20e05a6d')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a6b57ea-fb, col_values=(('external_ids', {'iface-id': '5a6b57ea-fb79-4587-a514-43ffa86697b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:71:70', 'vm-uuid': '55399569-7ba7-4e75-9ded-1e9d6a7832d3'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:13 user nova-compute[75285]: INFO os_vif [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:71:70,bridge_name='br-int',has_traffic_filtering=True,id=5a6b57ea-fb79-4587-a514-43ffa86697b2,network=Network(310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6b57ea-fb')
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-de9881d1-622f-4f60-8fce-fdfba1ef7e9b req-10a92b8d-5f5e-42a5-b5a7-29477d107a6c service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-de9881d1-622f-4f60-8fce-fdfba1ef7e9b req-10a92b8d-5f5e-42a5-b5a7-29477d107a6c service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-de9881d1-622f-4f60-8fce-fdfba1ef7e9b req-10a92b8d-5f5e-42a5-b5a7-29477d107a6c service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-de9881d1-622f-4f60-8fce-fdfba1ef7e9b req-10a92b8d-5f5e-42a5-b5a7-29477d107a6c service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-de9881d1-622f-4f60-8fce-fdfba1ef7e9b req-10a92b8d-5f5e-42a5-b5a7-29477d107a6c service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:15:13 user nova-compute[75285]: WARNING nova.compute.manager [req-de9881d1-622f-4f60-8fce-fdfba1ef7e9b req-10a92b8d-5f5e-42a5-b5a7-29477d107a6c service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] No VIF found with MAC fa:16:3e:bf:71:70, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.network.neutron [req-af280450-f860-469a-9e3d-8d64cab6bcd4 req-41b6326c-f7c7-49ed-98e0-77ab20ba40fd service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Updated VIF entry in instance network info cache for port 5a6b57ea-fb79-4587-a514-43ffa86697b2. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG nova.network.neutron [req-af280450-f860-469a-9e3d-8d64cab6bcd4 req-41b6326c-f7c7-49ed-98e0-77ab20ba40fd service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Updating instance_info_cache with network_info: [{"id": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "address": "fa:16:3e:bf:71:70", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6b57ea-fb", "ovs_interfaceid": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:15:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-af280450-f860-469a-9e3d-8d64cab6bcd4 req-41b6326c-f7c7-49ed-98e0-77ab20ba40fd service nova] Releasing lock "refresh_cache-55399569-7ba7-4e75-9ded-1e9d6a7832d3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:15:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-a8ea2ac2-f784-469d-ac18-5708f68896e4 req-e36fcc1a-9237-4da4-98d8-271212cd2dfb service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-changed-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-a8ea2ac2-f784-469d-ac18-5708f68896e4 req-e36fcc1a-9237-4da4-98d8-271212cd2dfb service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Refreshing instance network info cache due to event network-changed-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:15:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a8ea2ac2-f784-469d-ac18-5708f68896e4 req-e36fcc1a-9237-4da4-98d8-271212cd2dfb service nova] Acquiring lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:15:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a8ea2ac2-f784-469d-ac18-5708f68896e4 req-e36fcc1a-9237-4da4-98d8-271212cd2dfb service nova] Acquired lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:15:14 user nova-compute[75285]: DEBUG nova.network.neutron [req-a8ea2ac2-f784-469d-ac18-5708f68896e4 req-e36fcc1a-9237-4da4-98d8-271212cd2dfb service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Refreshing network info cache for port bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:15:14 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Instance destroyed successfully.
Nov 10 21:15:14 user nova-compute[75285]: DEBUG nova.network.neutron [req-a8ea2ac2-f784-469d-ac18-5708f68896e4 req-e36fcc1a-9237-4da4-98d8-271212cd2dfb service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updated VIF entry in instance network info cache for port bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:15:14 user nova-compute[75285]: DEBUG nova.network.neutron [req-a8ea2ac2-f784-469d-ac18-5708f68896e4 req-e36fcc1a-9237-4da4-98d8-271212cd2dfb service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updating instance_info_cache with network_info: [{"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:15:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a8ea2ac2-f784-469d-ac18-5708f68896e4 req-e36fcc1a-9237-4da4-98d8-271212cd2dfb service nova] Releasing lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:15:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-c1c36e79-8606-47f2-bd6a-78db532a3ae3 req-a32a3bd4-a04c-4241-8788-53099131590c service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c1c36e79-8606-47f2-bd6a-78db532a3ae3 req-a32a3bd4-a04c-4241-8788-53099131590c service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c1c36e79-8606-47f2-bd6a-78db532a3ae3 req-a32a3bd4-a04c-4241-8788-53099131590c service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c1c36e79-8606-47f2-bd6a-78db532a3ae3 req-a32a3bd4-a04c-4241-8788-53099131590c service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-c1c36e79-8606-47f2-bd6a-78db532a3ae3 req-a32a3bd4-a04c-4241-8788-53099131590c service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:15:15 user nova-compute[75285]: WARNING nova.compute.manager [req-c1c36e79-8606-47f2-bd6a-78db532a3ae3 req-a32a3bd4-a04c-4241-8788-53099131590c service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:15:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-changed-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Refreshing instance network info cache due to event network-changed-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] Acquiring lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] Acquired lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG nova.network.neutron [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Refreshing network info cache for port bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG nova.network.neutron [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updated VIF entry in instance network info cache for port bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG nova.network.neutron [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updating instance_info_cache with network_info: [{"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] Releasing lock "refresh_cache-09ab2e54-1189-420e-9e5c-d158e4106ffd" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Received event network-vif-plugged-5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] Acquiring lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] No waiting events found dispatching network-vif-plugged-5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:15:16 user nova-compute[75285]: WARNING nova.compute.manager [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Received unexpected event network-vif-plugged-5a6b57ea-fb79-4587-a514-43ffa86697b2 for instance with vm_state building and task_state spawning.
Nov 10 21:15:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Received event network-vif-plugged-5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] Acquiring lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] No waiting events found dispatching network-vif-plugged-5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:15:16 user nova-compute[75285]: WARNING nova.compute.manager [req-e99c6533-d51a-4fe5-ab24-b47ad339d793 req-b9653acd-2c34-4c4a-9953-081deb139a4a service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Received unexpected event network-vif-plugged-5a6b57ea-fb79-4587-a514-43ffa86697b2 for instance with vm_state building and task_state spawning.
Nov 10 21:15:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-b8a2c277-676b-4d0c-8a35-c1aa60588ac1 req-e9366612-d713-486f-b074-e1e09f859fd3 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b8a2c277-676b-4d0c-8a35-c1aa60588ac1 req-e9366612-d713-486f-b074-e1e09f859fd3 service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b8a2c277-676b-4d0c-8a35-c1aa60588ac1 req-e9366612-d713-486f-b074-e1e09f859fd3 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b8a2c277-676b-4d0c-8a35-c1aa60588ac1 req-e9366612-d713-486f-b074-e1e09f859fd3 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-b8a2c277-676b-4d0c-8a35-c1aa60588ac1 req-e9366612-d713-486f-b074-e1e09f859fd3 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:15:17 user nova-compute[75285]: WARNING nova.compute.manager [req-b8a2c277-676b-4d0c-8a35-c1aa60588ac1 req-e9366612-d713-486f-b074-e1e09f859fd3 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:15:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-b8a2c277-676b-4d0c-8a35-c1aa60588ac1 req-e9366612-d713-486f-b074-e1e09f859fd3 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b8a2c277-676b-4d0c-8a35-c1aa60588ac1 req-e9366612-d713-486f-b074-e1e09f859fd3 service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b8a2c277-676b-4d0c-8a35-c1aa60588ac1 req-e9366612-d713-486f-b074-e1e09f859fd3 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b8a2c277-676b-4d0c-8a35-c1aa60588ac1 req-e9366612-d713-486f-b074-e1e09f859fd3 service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-b8a2c277-676b-4d0c-8a35-c1aa60588ac1 req-e9366612-d713-486f-b074-e1e09f859fd3 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:15:17 user nova-compute[75285]: WARNING nova.compute.manager [req-b8a2c277-676b-4d0c-8a35-c1aa60588ac1 req-e9366612-d713-486f-b074-e1e09f859fd3 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:15:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:15:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:15:19 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Instance spawned successfully.
Nov 10 21:15:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:15:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:15:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:15:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:15:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:15:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:15:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:15:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2b99785a-d8ec-4942-9487-7c87e2404919 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:15:19 user nova-compute[75285]: INFO nova.compute.manager [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Took 8.23 seconds to spawn the instance on the hypervisor.
Nov 10 21:15:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:15:19 user nova-compute[75285]: INFO nova.compute.manager [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Took 9.12 seconds to build instance.
Nov 10 21:15:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a6333229-d26f-41c1-b6cf-5355e1827b51 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.276s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:40 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:15:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-f251f470-3067-4f47-8cbc-7ac8ac147a9b req-047fd8c9-3e28-4066-95cb-de8f5adbc7ad service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Received event network-changed-05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-f251f470-3067-4f47-8cbc-7ac8ac147a9b req-047fd8c9-3e28-4066-95cb-de8f5adbc7ad service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Refreshing instance network info cache due to event network-changed-05305385-566b-49c0-a6c0-50fb2b7e9170. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:15:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f251f470-3067-4f47-8cbc-7ac8ac147a9b req-047fd8c9-3e28-4066-95cb-de8f5adbc7ad service nova] Acquiring lock "refresh_cache-278ff84f-a732-4d81-81e5-74df508c9f11" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:15:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f251f470-3067-4f47-8cbc-7ac8ac147a9b req-047fd8c9-3e28-4066-95cb-de8f5adbc7ad service nova] Acquired lock "refresh_cache-278ff84f-a732-4d81-81e5-74df508c9f11" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:15:41 user nova-compute[75285]: DEBUG nova.network.neutron [req-f251f470-3067-4f47-8cbc-7ac8ac147a9b req-047fd8c9-3e28-4066-95cb-de8f5adbc7ad service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Refreshing network info cache for port 05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG nova.network.neutron [req-f251f470-3067-4f47-8cbc-7ac8ac147a9b req-047fd8c9-3e28-4066-95cb-de8f5adbc7ad service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Updated VIF entry in instance network info cache for port 05305385-566b-49c0-a6c0-50fb2b7e9170. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG nova.network.neutron [req-f251f470-3067-4f47-8cbc-7ac8ac147a9b req-047fd8c9-3e28-4066-95cb-de8f5adbc7ad service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Updating instance_info_cache with network_info: [{"id": "05305385-566b-49c0-a6c0-50fb2b7e9170", "address": "fa:16:3e:b5:0e:61", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05305385-56", "ovs_interfaceid": "05305385-566b-49c0-a6c0-50fb2b7e9170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f251f470-3067-4f47-8cbc-7ac8ac147a9b req-047fd8c9-3e28-4066-95cb-de8f5adbc7ad service nova] Releasing lock "refresh_cache-278ff84f-a732-4d81-81e5-74df508c9f11" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "278ff84f-a732-4d81-81e5-74df508c9f11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "278ff84f-a732-4d81-81e5-74df508c9f11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:42 user nova-compute[75285]: INFO nova.compute.manager [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Terminating instance
Nov 10 21:15:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG nova.compute.manager [req-b2dde8ed-fa67-4b31-ad07-2dcb92198e71 req-74cc34a2-ca2d-4c04-a7bf-47cfa3cc1f69 service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Received event network-vif-unplugged-05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b2dde8ed-fa67-4b31-ad07-2dcb92198e71 req-74cc34a2-ca2d-4c04-a7bf-47cfa3cc1f69 service nova] Acquiring lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b2dde8ed-fa67-4b31-ad07-2dcb92198e71 req-74cc34a2-ca2d-4c04-a7bf-47cfa3cc1f69 service nova] Lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b2dde8ed-fa67-4b31-ad07-2dcb92198e71 req-74cc34a2-ca2d-4c04-a7bf-47cfa3cc1f69 service nova] Lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG nova.compute.manager [req-b2dde8ed-fa67-4b31-ad07-2dcb92198e71 req-74cc34a2-ca2d-4c04-a7bf-47cfa3cc1f69 service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] No waiting events found dispatching network-vif-unplugged-05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:15:42 user nova-compute[75285]: DEBUG nova.compute.manager [req-b2dde8ed-fa67-4b31-ad07-2dcb92198e71 req-74cc34a2-ca2d-4c04-a7bf-47cfa3cc1f69 service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Received event network-vif-unplugged-05305385-566b-49c0-a6c0-50fb2b7e9170 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:15:43 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Instance destroyed successfully.
Nov 10 21:15:43 user nova-compute[75285]: DEBUG nova.objects.instance [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lazy-loading 'resources' on Instance uuid 278ff84f-a732-4d81-81e5-74df508c9f11 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:13:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-567390446',display_name='tempest-TestVolumeBootPattern-server-567390446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-567390446',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAAoUPxLI+zueb7o2tu1JS76f604TN+uq+pfg2zYS5MbkMZtx1Ub2kBFu6OB71sTNt8tpmOHljKAgKzRpBKVdyr/VTj1zgWyamAFtpMuzpYAL+WhfMApRgNi/CTwdcWlw==',key_name='tempest-TestVolumeBootPattern-2083573923',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04636b8a9e404d40a3a2bc9f63a4df8c',ramdisk_id='',reservation_id='r-lfw1q9yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1962512242',owner_user_name='tempest-TestVolumeBootPattern-1962512242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:14:27Z,user_data=None,user_id='e16c471c0875416aa0eb86d89eef3a27',uuid=278ff84f-a732-4d81-81e5-74df508c9f11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05305385-566b-49c0-a6c0-50fb2b7e9170", "address": "fa:16:3e:b5:0e:61", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05305385-56", "ovs_interfaceid": "05305385-566b-49c0-a6c0-50fb2b7e9170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converting VIF {"id": "05305385-566b-49c0-a6c0-50fb2b7e9170", "address": "fa:16:3e:b5:0e:61", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05305385-56", "ovs_interfaceid": "05305385-566b-49c0-a6c0-50fb2b7e9170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0e:61,bridge_name='br-int',has_traffic_filtering=True,id=05305385-566b-49c0-a6c0-50fb2b7e9170,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05305385-56') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_vif [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0e:61,bridge_name='br-int',has_traffic_filtering=True,id=05305385-566b-49c0-a6c0-50fb2b7e9170,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05305385-56') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05305385-56, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50dedf14-2d77-4abd-b987-fcd41fae9c60) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:43 user nova-compute[75285]: INFO os_vif [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0e:61,bridge_name='br-int',has_traffic_filtering=True,id=05305385-566b-49c0-a6c0-50fb2b7e9170,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05305385-56')
Nov 10 21:15:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZFsAejg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:15:43 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[680f6822-bb40-43ff-a7fe-f4bedff421a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:15:43 user nova-compute[75285]: No targets found.
Nov 10 21:15:43 user nova-compute[75285]: iSNS:
Nov 10 21:15:43 user nova-compute[75285]: No targets found.
Nov 10 21:15:43 user nova-compute[75285]: STATIC:
Nov 10 21:15:43 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:15:43 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:15:43 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:15:43 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c
Nov 10 21:15:43 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:15:43 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:15:43 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437
Nov 10 21:15:43 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:15:43 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:15:43 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19
Nov 10 21:15:43 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:15:43 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:15:43 user nova-compute[75285]: FIRMWARE:
Nov 10 21:15:43 user nova-compute[75285]: No targets found.
Nov 10 21:15:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:15:43 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:15:43 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a65ef6-2a6f-4b79-b30d-c8a1a941ad1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7117aea6-af09-4742-85de-3b5199236a38]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:15:43 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:15:43 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:15:43 user nova-compute[75285]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:15:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:15:43 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:15:43 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:15:43 user nova-compute[75285]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:15:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a0427e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c'): ({'sde'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Removing single pathed devices sde {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7392380f-d74f-4b1e-89c2-bbeabac92778]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2292a4-dbd1-4949-8080-7c7a621baae4]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Flushing IO for device /dev/sde {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[340a2706-798d-4779-9a04-68df40030593]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee20333e-9b48-4449-899b-92cc7bba093d]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] SCSI volumes sde have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_37a009cc', '/dev/disk/by-id/scsi-1SCST_BIO37a009cc-85ceb7a9c5b97da1', '/dev/disk/by-id/scsi-23835636562376139') {{(pid=86427) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9469e2-ee88-431e-9fa5-679186470a1a]: (4, None) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5124713d-f88d-45e3-ae45-1f13eb514e61]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63f35d5-dc66-4e6d-a163-bcd8e1170f62]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260]
Nov 10 21:15:43 user nova-compute[75285]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260] successful.
Nov 10 21:15:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6dcaf8-d457-4a28-9fb7-b83a9869b829]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] <== disconnect_volume: return (393ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:15:43 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Deleting instance files /opt/stack/data/nova/instances/278ff84f-a732-4d81-81e5-74df508c9f11_del
Nov 10 21:15:43 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Deletion of /opt/stack/data/nova/instances/278ff84f-a732-4d81-81e5-74df508c9f11_del complete
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "073785c4-a92c-4297-ab62-55c31b424ffc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:43 user nova-compute[75285]: INFO nova.compute.manager [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Unshelving
Nov 10 21:15:43 user nova-compute[75285]: INFO nova.compute.manager [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:15:43 user nova-compute[75285]: INFO nova.virt.block_device [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Booting with volume 91772543-be49-49fb-9f3a-8181317c507c at /dev/vdc
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.utils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0157fb2d-60c3-4891-b3c3-4017ec286459]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f138ff0-70bc-465c-b653-9cf349f617ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[392b40bd-b266-4cc2-aae7-864d48556f6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a933bb0c-2968-46e3-b8fe-f88672774eb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:15:43 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:15:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaea22ed-613f-478a-bbd7-f2c67d2aa314]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG os_brick.utils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:15:43 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Updating existing volume attachment record: 95b095f4-f647-4dda-9422-a5801e1cef43 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:15:44 user nova-compute[75285]: DEBUG nova.compute.manager [req-06031e3d-d410-45f5-bcd4-0567834b033c req-f1429aef-8fd6-4dff-8a10-e335895017ac service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Received event network-vif-plugged-05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-06031e3d-d410-45f5-bcd4-0567834b033c req-f1429aef-8fd6-4dff-8a10-e335895017ac service nova] Acquiring lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-06031e3d-d410-45f5-bcd4-0567834b033c req-f1429aef-8fd6-4dff-8a10-e335895017ac service nova] Lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-06031e3d-d410-45f5-bcd4-0567834b033c req-f1429aef-8fd6-4dff-8a10-e335895017ac service nova] Lock "278ff84f-a732-4d81-81e5-74df508c9f11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:44 user nova-compute[75285]: DEBUG nova.compute.manager [req-06031e3d-d410-45f5-bcd4-0567834b033c req-f1429aef-8fd6-4dff-8a10-e335895017ac service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] No waiting events found dispatching network-vif-plugged-05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:15:44 user nova-compute[75285]: WARNING nova.compute.manager [req-06031e3d-d410-45f5-bcd4-0567834b033c req-f1429aef-8fd6-4dff-8a10-e335895017ac service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Received unexpected event network-vif-plugged-05305385-566b-49c0-a6c0-50fb2b7e9170 for instance with vm_state active and task_state deleting.
Nov 10 21:15:45 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Updating instance_info_cache with network_info: [{"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-62e8cc12-802e-415c-a166-4590715372c5" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:15:45 user nova-compute[75285]: INFO nova.compute.manager [None req-7eb66791-59d4-4c6f-9480-6dd7a7ec3cb0 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Unrescuing
Nov 10 21:15:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7eb66791-59d4-4c6f-9480-6dd7a7ec3cb0 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7eb66791-59d4-4c6f-9480-6dd7a7ec3cb0 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquired lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG nova.network.neutron [None req-7eb66791-59d4-4c6f-9480-6dd7a7ec3cb0 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:15:45 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Took 1.65 seconds to deallocate network for instance.
Nov 10 21:15:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-5b581af2-7c19-467d-8c66-b75c39a64898 req-92e363cf-ebdc-431d-b4df-c02074fa99c2 service nova] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Received event network-vif-deleted-05305385-566b-49c0-a6c0-50fb2b7e9170 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG nova.network.neutron [None req-7eb66791-59d4-4c6f-9480-6dd7a7ec3cb0 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Updating instance_info_cache with network_info: [{"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7eb66791-59d4-4c6f-9480-6dd7a7ec3cb0 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Releasing lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG nova.objects.instance [None req-7eb66791-59d4-4c6f-9480-6dd7a7ec3cb0 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'flavor' on Instance uuid 0ad7b009-e56f-48ae-8643-29abadf283a4 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:46 user nova-compute[75285]: INFO nova.compute.manager [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Detaching volume 822836c3-ad6b-4714-a890-5dfb85ba0b19
Nov 10 21:15:46 user nova-compute[75285]: INFO nova.virt.block_device [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Attempting to driver detach volume 822836c3-ad6b-4714-a890-5dfb85ba0b19 from mountpoint /dev/vdb
Nov 10 21:15:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Attempting to detach device vdb from instance 09ab2e54-1189-420e-9e5c-d158e4106ffd from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:15:46 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:15:46 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:15:46 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:15:46 user nova-compute[75285]:   <serial>822836c3-ad6b-4714-a890-5dfb85ba0b19</serial>
Nov 10 21:15:46 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:15:46 user nova-compute[75285]: </disk>
Nov 10 21:15:46 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:46 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Successfully detached device vdb from instance 09ab2e54-1189-420e-9e5c-d158e4106ffd from the persistent domain config.
Nov 10 21:15:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09ab2e54-1189-420e-9e5c-d158e4106ffd from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:15:46 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:15:46 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:15:46 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:15:46 user nova-compute[75285]:   <serial>822836c3-ad6b-4714-a890-5dfb85ba0b19</serial>
Nov 10 21:15:46 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:15:46 user nova-compute[75285]: </disk>
Nov 10 21:15:46 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:46 user nova-compute[75285]: INFO nova.compute.manager [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 278ff84f-a732-4d81-81e5-74df508c9f11] Took 1.13 seconds to detach 1 volumes for instance.
Nov 10 21:15:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:46 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Instance destroyed successfully.
Nov 10 21:15:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09ab2e54-1189-420e-9e5c-d158e4106ffd {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:46 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.616s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:47 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Deleted allocations for instance 278ff84f-a732-4d81-81e5-74df508c9f11
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e6f5152e-e86c-427d-b5e9-8e715947cb1c tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "278ff84f-a732-4d81-81e5-74df508c9f11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.094s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-8ebbcc3d-a27d-4a06-a10a-981a90f53190 req-6957055b-0753-4d3b-b538-c2135657f527 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-vif-unplugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8ebbcc3d-a27d-4a06-a10a-981a90f53190 req-6957055b-0753-4d3b-b538-c2135657f527 service nova] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8ebbcc3d-a27d-4a06-a10a-981a90f53190 req-6957055b-0753-4d3b-b538-c2135657f527 service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8ebbcc3d-a27d-4a06-a10a-981a90f53190 req-6957055b-0753-4d3b-b538-c2135657f527 service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-8ebbcc3d-a27d-4a06-a10a-981a90f53190 req-6957055b-0753-4d3b-b538-c2135657f527 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] No waiting events found dispatching network-vif-unplugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:15:47 user nova-compute[75285]: WARNING nova.compute.manager [req-8ebbcc3d-a27d-4a06-a10a-981a90f53190 req-6957055b-0753-4d3b-b538-c2135657f527 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received unexpected event network-vif-unplugged-ea61ffb9-f415-4c97-850b-56d25719be25 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:15:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-8ebbcc3d-a27d-4a06-a10a-981a90f53190 req-6957055b-0753-4d3b-b538-c2135657f527 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8ebbcc3d-a27d-4a06-a10a-981a90f53190 req-6957055b-0753-4d3b-b538-c2135657f527 service nova] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8ebbcc3d-a27d-4a06-a10a-981a90f53190 req-6957055b-0753-4d3b-b538-c2135657f527 service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8ebbcc3d-a27d-4a06-a10a-981a90f53190 req-6957055b-0753-4d3b-b538-c2135657f527 service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-8ebbcc3d-a27d-4a06-a10a-981a90f53190 req-6957055b-0753-4d3b-b538-c2135657f527 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] No waiting events found dispatching network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:15:47 user nova-compute[75285]: WARNING nova.compute.manager [req-8ebbcc3d-a27d-4a06-a10a-981a90f53190 req-6957055b-0753-4d3b-b538-c2135657f527 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received unexpected event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG nova.compute.manager [req-3b5d16b4-e0a3-4516-8f7f-3f8d7937b7ca req-179a5171-7c99-4740-a243-d29fca86104d service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3b5d16b4-e0a3-4516-8f7f-3f8d7937b7ca req-179a5171-7c99-4740-a243-d29fca86104d service nova] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3b5d16b4-e0a3-4516-8f7f-3f8d7937b7ca req-179a5171-7c99-4740-a243-d29fca86104d service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3b5d16b4-e0a3-4516-8f7f-3f8d7937b7ca req-179a5171-7c99-4740-a243-d29fca86104d service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG nova.compute.manager [req-3b5d16b4-e0a3-4516-8f7f-3f8d7937b7ca req-179a5171-7c99-4740-a243-d29fca86104d service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] No waiting events found dispatching network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:15:49 user nova-compute[75285]: WARNING nova.compute.manager [req-3b5d16b4-e0a3-4516-8f7f-3f8d7937b7ca req-179a5171-7c99-4740-a243-d29fca86104d service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received unexpected event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:15:49 user nova-compute[75285]: DEBUG nova.compute.manager [req-3b5d16b4-e0a3-4516-8f7f-3f8d7937b7ca req-179a5171-7c99-4740-a243-d29fca86104d service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3b5d16b4-e0a3-4516-8f7f-3f8d7937b7ca req-179a5171-7c99-4740-a243-d29fca86104d service nova] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3b5d16b4-e0a3-4516-8f7f-3f8d7937b7ca req-179a5171-7c99-4740-a243-d29fca86104d service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3b5d16b4-e0a3-4516-8f7f-3f8d7937b7ca req-179a5171-7c99-4740-a243-d29fca86104d service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG nova.compute.manager [req-3b5d16b4-e0a3-4516-8f7f-3f8d7937b7ca req-179a5171-7c99-4740-a243-d29fca86104d service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] No waiting events found dispatching network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:15:49 user nova-compute[75285]: WARNING nova.compute.manager [req-3b5d16b4-e0a3-4516-8f7f-3f8d7937b7ca req-179a5171-7c99-4740-a243-d29fca86104d service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received unexpected event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:15:49 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-7eb66791-59d4-4c6f-9480-6dd7a7ec3cb0 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:15:50 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:15:50 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:15:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7631MB free_disk=24.98758316040039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 09ab2e54-1189-420e-9e5c-d158e4106ffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3a0c67ef-1414-47e0-8769-c9164baf8993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 0ad7b009-e56f-48ae-8643-29abadf283a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 55399569-7ba7-4e75-9ded-1e9d6a7832d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 073785c4-a92c-4297-ab62-55c31b424ffc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:15:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:15:51 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:15:51 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:15:51 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:15:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:15:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:54 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:15:54 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:15:54 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:15:55 user nova-compute[75285]: DEBUG nova.compute.manager [req-c0544b47-ccca-4dac-b9e9-4cc66b362217 req-d7a5f31e-95ad-41c0-8a0e-5ac56ebff765 service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Received event network-changed-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:15:55 user nova-compute[75285]: DEBUG nova.compute.manager [req-c0544b47-ccca-4dac-b9e9-4cc66b362217 req-d7a5f31e-95ad-41c0-8a0e-5ac56ebff765 service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Refreshing instance network info cache due to event network-changed-a04ef93a-fdc5-4229-a69a-1b2daf6f5995. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:15:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c0544b47-ccca-4dac-b9e9-4cc66b362217 req-d7a5f31e-95ad-41c0-8a0e-5ac56ebff765 service nova] Acquiring lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:15:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c0544b47-ccca-4dac-b9e9-4cc66b362217 req-d7a5f31e-95ad-41c0-8a0e-5ac56ebff765 service nova] Acquired lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:15:55 user nova-compute[75285]: DEBUG nova.network.neutron [req-c0544b47-ccca-4dac-b9e9-4cc66b362217 req-d7a5f31e-95ad-41c0-8a0e-5ac56ebff765 service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Refreshing network info cache for port a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:15:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:15:56 user nova-compute[75285]: DEBUG nova.network.neutron [req-c0544b47-ccca-4dac-b9e9-4cc66b362217 req-d7a5f31e-95ad-41c0-8a0e-5ac56ebff765 service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updated VIF entry in instance network info cache for port a04ef93a-fdc5-4229-a69a-1b2daf6f5995. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:15:56 user nova-compute[75285]: DEBUG nova.network.neutron [req-c0544b47-ccca-4dac-b9e9-4cc66b362217 req-d7a5f31e-95ad-41c0-8a0e-5ac56ebff765 service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updating instance_info_cache with network_info: [{"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:15:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c0544b47-ccca-4dac-b9e9-4cc66b362217 req-d7a5f31e-95ad-41c0-8a0e-5ac56ebff765 service nova] Releasing lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:15:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:06 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 09ab2e54-1189-420e-9e5c-d158e4106ffd is timed out.
Nov 10 21:16:06 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Successfully detached device vdb from instance 09ab2e54-1189-420e-9e5c-d158e4106ffd from the live domain config.
Nov 10 21:16:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCWcAdSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:16:06 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd738fe2-1b42-414e-bee5-e243ae8a5186]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:16:06 user nova-compute[75285]: No targets found.
Nov 10 21:16:06 user nova-compute[75285]: iSNS:
Nov 10 21:16:06 user nova-compute[75285]: No targets found.
Nov 10 21:16:06 user nova-compute[75285]: STATIC:
Nov 10 21:16:06 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:16:06 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:16:06 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:16:06 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437
Nov 10 21:16:06 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:16:06 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:16:06 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19
Nov 10 21:16:06 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:16:06 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:16:06 user nova-compute[75285]: FIRMWARE:
Nov 10 21:16:06 user nova-compute[75285]: No targets found.
Nov 10 21:16:06 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:16:06 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:16:06 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9d8acd-08c4-446b-a158-3b436e8903f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81077d5-6536-4aee-b9bb-8ce19595fad7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:16:06 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:16:06 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:16:06 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 (non-flash)
Nov 10 21:16:06 user nova-compute[75285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:16:06 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:16:06 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49fc353c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[814ca87b-b448-4633-b0f1-4773ce5c6613]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfa0d9a-b4e6-405b-98c3-a83bc60c8929]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e7161d-23c6-4306-95ab-972d881c2f12]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d9937b-5f1f-418c-93f9-d7f39ee184d6]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[779e254c-c2ed-45bb-bdc5-3e42bd047ce8]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:16:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:07 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7edf88-a7c9-4f18-96fc-3c4c690d6dbc]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19, portal: 172.16.0.220,3260]
Nov 10 21:16:07 user nova-compute[75285]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19, portal: 172.16.0.220,3260] successful.
Nov 10 21:16:07 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:16:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:822836c3-ad6b-4714-a890-5dfb85ba0b19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:07 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[090bac98-3028-4893-9759-29ad900a2a7d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:16:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:16:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] <== disconnect_volume: return (303ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:16:07 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:16:08 user nova-compute[75285]: DEBUG nova.objects.instance [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lazy-loading 'flavor' on Instance uuid 09ab2e54-1189-420e-9e5c-d158e4106ffd {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:16:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-447489b8-b0e5-4927-a705-0167f3354d70 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.963s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:24 user nova-compute[75285]: INFO nova.compute.manager [None req-94c783dd-2b7d-47be-b75a-6db9524afb16 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Unrescuing
Nov 10 21:16:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94c783dd-2b7d-47be-b75a-6db9524afb16 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:16:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94c783dd-2b7d-47be-b75a-6db9524afb16 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquired lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:16:24 user nova-compute[75285]: DEBUG nova.network.neutron [None req-94c783dd-2b7d-47be-b75a-6db9524afb16 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:16:24 user nova-compute[75285]: DEBUG nova.network.neutron [None req-94c783dd-2b7d-47be-b75a-6db9524afb16 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Updating instance_info_cache with network_info: [{"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:16:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94c783dd-2b7d-47be-b75a-6db9524afb16 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Releasing lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:16:24 user nova-compute[75285]: DEBUG nova.objects.instance [None req-94c783dd-2b7d-47be-b75a-6db9524afb16 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'flavor' on Instance uuid ac0ddf13-9584-4e5d-99be-ad8feb6c532f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:16:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-c162afad-d4ad-47ed-9a3c-560680b27921 req-13f46fc1-03f5-4e46-b745-bf24020e6296 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-unplugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c162afad-d4ad-47ed-9a3c-560680b27921 req-13f46fc1-03f5-4e46-b745-bf24020e6296 service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c162afad-d4ad-47ed-9a3c-560680b27921 req-13f46fc1-03f5-4e46-b745-bf24020e6296 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c162afad-d4ad-47ed-9a3c-560680b27921 req-13f46fc1-03f5-4e46-b745-bf24020e6296 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-c162afad-d4ad-47ed-9a3c-560680b27921 req-13f46fc1-03f5-4e46-b745-bf24020e6296 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-unplugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:25 user nova-compute[75285]: WARNING nova.compute.manager [req-c162afad-d4ad-47ed-9a3c-560680b27921 req-13f46fc1-03f5-4e46-b745-bf24020e6296 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-unplugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:16:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:25 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Instance destroyed successfully.
Nov 10 21:16:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:27 user nova-compute[75285]: WARNING nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:16:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:27 user nova-compute[75285]: WARNING nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:16:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:27 user nova-compute[75285]: WARNING nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:16:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-unplugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-unplugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:27 user nova-compute[75285]: WARNING nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-unplugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:16:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:27 user nova-compute[75285]: WARNING nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:16:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:27 user nova-compute[75285]: WARNING nova.compute.manager [req-7565f60b-1371-4fff-bf67-1ceaeebf27dd req-dde453a7-806d-4a9f-a373-e7c2f0f840ab service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:16:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:28 user nova-compute[75285]: DEBUG nova.compute.manager [None req-94c783dd-2b7d-47be-b75a-6db9524afb16 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:16:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-9b73ad28-6d15-483f-a48d-a68a11f4fbd0 req-3f374c0b-201e-47f2-becc-adfd8ef1b7d7 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9b73ad28-6d15-483f-a48d-a68a11f4fbd0 req-3f374c0b-201e-47f2-becc-adfd8ef1b7d7 service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9b73ad28-6d15-483f-a48d-a68a11f4fbd0 req-3f374c0b-201e-47f2-becc-adfd8ef1b7d7 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9b73ad28-6d15-483f-a48d-a68a11f4fbd0 req-3f374c0b-201e-47f2-becc-adfd8ef1b7d7 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-9b73ad28-6d15-483f-a48d-a68a11f4fbd0 req-3f374c0b-201e-47f2-becc-adfd8ef1b7d7 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:29 user nova-compute[75285]: WARNING nova.compute.manager [req-9b73ad28-6d15-483f-a48d-a68a11f4fbd0 req-3f374c0b-201e-47f2-becc-adfd8ef1b7d7 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state active and task_state None.
Nov 10 21:16:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:32 user nova-compute[75285]: DEBUG nova.objects.instance [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'pci_requests' on Instance uuid 073785c4-a92c-4297-ab62-55c31b424ffc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:16:32 user nova-compute[75285]: DEBUG nova.objects.instance [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'numa_topology' on Instance uuid 073785c4-a92c-4297-ab62-55c31b424ffc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:16:32 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:16:32 user nova-compute[75285]: INFO nova.compute.claims [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Claim successful on node user
Nov 10 21:16:32 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:16:32 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:16:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:32 user nova-compute[75285]: INFO nova.network.neutron [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Updating port e23cea65-b47d-4daf-8640-b3617916099e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquired lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG nova.network.neutron [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-6782e9d6-eac3-42fb-9cf7-71f7482e4b24 req-86d8e916-71f8-4724-b582-fcedf5a3cb4c service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received event network-changed-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-6782e9d6-eac3-42fb-9cf7-71f7482e4b24 req-86d8e916-71f8-4724-b582-fcedf5a3cb4c service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Refreshing instance network info cache due to event network-changed-e23cea65-b47d-4daf-8640-b3617916099e. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6782e9d6-eac3-42fb-9cf7-71f7482e4b24 req-86d8e916-71f8-4724-b582-fcedf5a3cb4c service nova] Acquiring lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG nova.network.neutron [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Updating instance_info_cache with network_info: [{"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Releasing lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:16:33 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Creating image(s)
Nov 10 21:16:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "/opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "/opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "/opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG nova.objects.instance [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'trusted_certs' on Instance uuid 073785c4-a92c-4297-ab62-55c31b424ffc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6782e9d6-eac3-42fb-9cf7-71f7482e4b24 req-86d8e916-71f8-4724-b582-fcedf5a3cb4c service nova] Acquired lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG nova.network.neutron [req-6782e9d6-eac3-42fb-9cf7-71f7482e4b24 req-86d8e916-71f8-4724-b582-fcedf5a3cb4c service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Refreshing network info cache for port e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG nova.objects.base [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Object Instance<073785c4-a92c-4297-ab62-55c31b424ffc> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "585810571889046ffe61869eac0947a53b12a70d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "585810571889046ffe61869eac0947a53b12a70d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d.part --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG nova.compute.manager [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG nova.virt.images [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] 61c881d9-7940-4287-b8fa-21e2ba9d18a5 was qcow2, converting to raw {{(pid=75285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d.part /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d.converted {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:16:35 user nova-compute[75285]: INFO nova.compute.claims [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Claim successful on node user
Nov 10 21:16:35 user nova-compute[75285]: DEBUG nova.network.neutron [req-6782e9d6-eac3-42fb-9cf7-71f7482e4b24 req-86d8e916-71f8-4724-b582-fcedf5a3cb4c service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Updated VIF entry in instance network info cache for port e23cea65-b47d-4daf-8640-b3617916099e. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG nova.network.neutron [req-6782e9d6-eac3-42fb-9cf7-71f7482e4b24 req-86d8e916-71f8-4724-b582-fcedf5a3cb4c service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Updating instance_info_cache with network_info: [{"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6782e9d6-eac3-42fb-9cf7-71f7482e4b24 req-86d8e916-71f8-4724-b582-fcedf5a3cb4c service nova] Releasing lock "refresh_cache-073785c4-a92c-4297-ab62-55c31b424ffc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d.part /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d.converted" returned: 0 in 0.393s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d.converted --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "585810571889046ffe61869eac0947a53b12a70d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.828s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG nova.compute.manager [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG nova.compute.manager [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG nova.network.neutron [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:16:35 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:16:35 user nova-compute[75285]: DEBUG nova.compute.manager [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "585810571889046ffe61869eac0947a53b12a70d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "585810571889046ffe61869eac0947a53b12a70d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:35 user nova-compute[75285]: DEBUG nova.policy [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e16c471c0875416aa0eb86d89eef3a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04636b8a9e404d40a3a2bc9f63a4df8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:16:35 user nova-compute[75285]: INFO nova.virt.block_device [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Booting with volume aa895f68-63cb-4dad-aedf-9ac3c418b57c at /dev/vda
Nov 10 21:16:36 user nova-compute[75285]: DEBUG os_brick.utils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[936862da-fe69-427f-a775-8360c41ffeb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6f16a8-1f75-4ae5-9509-c9362d9cc180]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d,backing_fmt=raw /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3118997f-0c5e-4647-b9c0-1cd457329d44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b09152-a085-4aae-b01a-566de524c90a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d,backing_fmt=raw /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk 1073741824" returned: 0 in 0.078s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "585810571889046ffe61869eac0947a53b12a70d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:16:36 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec47fd65-a73d-41e5-88df-06410866f76b]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG os_brick.utils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Updating existing volume attachment record: 92f3f40c-6b98-4aff-9d83-24a1058877d7 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d --force-share --output=json" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG nova.objects.instance [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'migration_context' on Instance uuid 073785c4-a92c-4297-ab62-55c31b424ffc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG nova.objects.base [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Object Instance<073785c4-a92c-4297-ab62-55c31b424ffc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:16:36 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Rebasing disk image.
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 -F raw /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG nova.network.neutron [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Successfully created port: e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:36 user nova-compute[75285]: INFO nova.compute.manager [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Terminating instance
Nov 10 21:16:36 user nova-compute[75285]: DEBUG nova.compute.manager [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-266c6db9-6c84-43fb-a193-87446bef9664 req-15c76fb7-986b-446b-8b35-e760b126c66b service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-266c6db9-6c84-43fb-a193-87446bef9664 req-15c76fb7-986b-446b-8b35-e760b126c66b service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-266c6db9-6c84-43fb-a193-87446bef9664 req-15c76fb7-986b-446b-8b35-e760b126c66b service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-266c6db9-6c84-43fb-a193-87446bef9664 req-15c76fb7-986b-446b-8b35-e760b126c66b service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-266c6db9-6c84-43fb-a193-87446bef9664 req-15c76fb7-986b-446b-8b35-e760b126c66b service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-266c6db9-6c84-43fb-a193-87446bef9664 req-15c76fb7-986b-446b-8b35-e760b126c66b service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Instance destroyed successfully.
Nov 10 21:16:37 user nova-compute[75285]: DEBUG nova.objects.instance [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lazy-loading 'resources' on Instance uuid 09ab2e54-1189-420e-9e5c-d158e4106ffd {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:09:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-811159608',display_name='tempest-ServerStableDeviceRescueTest-server-811159608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-811159608',id=15,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU07Ee5gBfRVYMO1ihS+0v5mu4gwIvzqpIBvB/vUtCSDnxXiUb7ZTEwrZe/CpZEFTOFu4c1jqCagvop9YQAVI0CVZqSTeskkQBWLzNdLeTJXM3Pqa79j1/Ny7cbPqCWiw==',key_name='tempest-keypair-2027067703',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:13:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='159848b23a33449aa7eef3b73061912d',ramdisk_id='',reservation_id='r-0drfnm4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1367693602',owner_user_name='tempest-ServerStableDeviceRescueTest-1367693602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8a625a7d0264f49ad3ddbbdeca81fef',uuid=09ab2e54-1189-420e-9e5c-d158e4106ffd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Converting VIF {"id": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "address": "fa:16:3e:98:9a:13", "network": {"id": "1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1204432874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "159848b23a33449aa7eef3b73061912d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8d1ec8-27", "ovs_interfaceid": "bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9a:13,bridge_name='br-int',has_traffic_filtering=True,id=bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef,network=Network(1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8d1ec8-27') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG os_vif [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9a:13,bridge_name='br-int',has_traffic_filtering=True,id=bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef,network=Network(1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8d1ec8-27') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd8d1ec8-27, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adf1350b-bc7e-4489-a485-d08288ce5c8c) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:16:37 user nova-compute[75285]: INFO os_vif [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9a:13,bridge_name='br-int',has_traffic_filtering=True,id=bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef,network=Network(1dc32431-c79c-4a1c-b6eb-d1b0e549b0fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8d1ec8-27')
Nov 10 21:16:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Deleting instance files /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd_del
Nov 10 21:16:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Deletion of /opt/stack/data/nova/instances/09ab2e54-1189-420e-9e5c-d158e4106ffd_del complete
Nov 10 21:16:37 user nova-compute[75285]: DEBUG nova.network.neutron [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Successfully updated port: e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquired lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG nova.network.neutron [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:16:37 user nova-compute[75285]: INFO nova.compute.manager [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 10 21:16:37 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-b809ca08-e09d-4da0-8b9b-fb0886d03bd1 req-bace7b6d-83ab-4a6c-a67e-ac6d3940dbd3 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Received event network-changed-e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-b809ca08-e09d-4da0-8b9b-fb0886d03bd1 req-bace7b6d-83ab-4a6c-a67e-ac6d3940dbd3 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Refreshing instance network info cache due to event network-changed-e8496278-f4d1-49c1-9600-7cb6eb637b2a. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b809ca08-e09d-4da0-8b9b-fb0886d03bd1 req-bace7b6d-83ab-4a6c-a67e-ac6d3940dbd3 service nova] Acquiring lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:16:37 user nova-compute[75285]: DEBUG nova.network.neutron [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:16:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:38 user nova-compute[75285]: DEBUG nova.network.neutron [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Updating instance_info_cache with network_info: [{"id": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "address": "fa:16:3e:ef:5a:f0", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496278-f4", "ovs_interfaceid": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:16:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Releasing lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:16:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Instance network_info: |[{"id": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "address": "fa:16:3e:ef:5a:f0", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496278-f4", "ovs_interfaceid": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:16:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b809ca08-e09d-4da0-8b9b-fb0886d03bd1 req-bace7b6d-83ab-4a6c-a67e-ac6d3940dbd3 service nova] Acquired lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:16:38 user nova-compute[75285]: DEBUG nova.network.neutron [req-b809ca08-e09d-4da0-8b9b-fb0886d03bd1 req-bace7b6d-83ab-4a6c-a67e-ac6d3940dbd3 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Refreshing network info cache for port e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:16:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:39 user nova-compute[75285]: WARNING nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state active and task_state deleting.
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:39 user nova-compute[75285]: WARNING nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state active and task_state deleting.
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:39 user nova-compute[75285]: WARNING nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state active and task_state deleting.
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-unplugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Acquiring lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] No waiting events found dispatching network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:39 user nova-compute[75285]: WARNING nova.compute.manager [req-588fdf79-a463-47ac-bac2-7fd48dcbeb9e req-6a584e75-6e37-4fa1-824f-410d167f97ed service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received unexpected event network-vif-plugged-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef for instance with vm_state active and task_state deleting.
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 -F raw /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk" returned: 0 in 2.623s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Ensure instance console log exists: /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Start _get_guest_xml network_info=[{"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='12bc7a141af67ec934e1663220b41adc',container_format='bare',created_at=2023-11-10T21:13:50Z,direct_url=<?>,disk_format='qcow2',id=61c881d9-7940-4287-b8fa-21e2ba9d18a5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-252199540-shelved',owner='846fec1848ac4cbfa88b60ba0cf98e3c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T21:13:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '95b095f4-f647-4dda-9422-a5801e1cef43', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IYQVjhTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '073785c4-a92c-4297-ab62-55c31b424ffc', 'attached_at': '', 'detached_at': '', 'volume_id': '91772543-be49-49fb-9f3a-8181317c507c', 'serial': '91772543-be49-49fb-9f3a-8181317c507c'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:16:39 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:16:39 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='12bc7a141af67ec934e1663220b41adc',container_format='bare',created_at=2023-11-10T21:13:50Z,direct_url=<?>,disk_format='qcow2',id=61c881d9-7940-4287-b8fa-21e2ba9d18a5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-252199540-shelved',owner='846fec1848ac4cbfa88b60ba0cf98e3c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T21:13:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.objects.instance [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'vcpu_model' on Instance uuid 073785c4-a92c-4297-ab62-55c31b424ffc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.objects.base [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Object Instance<073785c4-a92c-4297-ab62-55c31b424ffc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IYQVjhTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:16:39 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:16:39 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:16:39 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[032b4992-96c3-4801-bdc5-19d1c7b3d15e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:16:39 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2080474-31f5-4285-90c0-da4ab787dc59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c] added
Nov 10 21:16:39 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d184de24-0a61-44ad-89cf-12ec2091089f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a26523-fe4c-4625-af35-0e65c463356d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IYQVjhTG {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IYQVjhTG" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e6e66f-df1c-4400-93c9-83540c3d5ee3]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IYQVjhTG'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[92456200-0f30-42d3-b3c1-c2939795306a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce77c2c7-d0fb-45b9-a68c-384c68bf999e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:16:39 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:16:39 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:16:39 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:16:39 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[02652eaa-e214-4f59-92f5-75d044b17a1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c, portal: 172.16.0.220,3260]
Nov 10 21:16:39 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c, portal: 172.16.0.220,3260] successful.
Nov 10 21:16:39 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c5c6f9-8e3a-4175-b567-be2bc4972a25]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.network.neutron [req-b809ca08-e09d-4da0-8b9b-fb0886d03bd1 req-bace7b6d-83ab-4a6c-a67e-ac6d3940dbd3 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Updated VIF entry in instance network info cache for port e8496278-f4d1-49c1-9600-7cb6eb637b2a. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.network.neutron [req-b809ca08-e09d-4da0-8b9b-fb0886d03bd1 req-bace7b6d-83ab-4a6c-a67e-ac6d3940dbd3 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Updating instance_info_cache with network_info: [{"id": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "address": "fa:16:3e:ef:5a:f0", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496278-f4", "ovs_interfaceid": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b809ca08-e09d-4da0-8b9b-fb0886d03bd1 req-bace7b6d-83ab-4a6c-a67e-ac6d3940dbd3 service nova] Releasing lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0b756d-5f9a-42ae-a0a2-baec03dc9f6f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:16:39 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:16:39 user nova-compute[75285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)
Nov 10 21:16:39 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:16:39 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:16:39 user nova-compute[75285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)
Nov 10 21:16:39 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0def6d68-e907-47af-80ae-08cd3f412f2c]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IYQVjhTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:16:39 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Took 1.87 seconds to deallocate network for instance.
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-a3fef729-8f74-44e0-978c-4332c0492467 req-520fb5e3-801c-465a-9c38-a2227304efe2 service nova] [instance: 09ab2e54-1189-420e-9e5c-d158e4106ffd] Received event network-vif-deleted-bd8d1ec8-27c2-480e-86f0-60bf0c66a8ef {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:40 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Deleted allocations for instance 09ab2e54-1189-420e-9e5c-d158e4106ffd
Nov 10 21:16:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17845ab7-30d9-4a6f-be5e-1c4bad377c40 tempest-ServerStableDeviceRescueTest-1367693602 tempest-ServerStableDeviceRescueTest-1367693602-project-member] Lock "09ab2e54-1189-420e-9e5c-d158e4106ffd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.428s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23137636264373766', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137636264373766', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T21:11:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-252199540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-252199540',id=20,image_ref='61c881d9-7940-4287-b8fa-21e2ba9d18a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1489604129',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:11:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='846fec1848ac4cbfa88b60ba0cf98e3c',ramdisk_id='',reservation_id='r-fi8ja34n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-605808320',owner_user_name='tempest-AttachVolumeShelveTestJSON-605808320-project-member',shelved_at='2023-11-10T21:13:55.669809',shelved_host='user',shelved_image_id='61c881d9-7940-4287-b8fa-21e2ba9d18a5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51709428ae324620840611f8eb1c216f',uuid=073785c4-a92c-4297-ab62-55c31b424ffc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converting VIF {"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=e23cea65-b47d-4daf-8640-b3617916099e,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape23cea65-b4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.objects.instance [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'pci_devices' on Instance uuid 073785c4-a92c-4297-ab62-55c31b424ffc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.objects.base [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Object Instance<073785c4-a92c-4297-ab62-55c31b424ffc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:16:40 user nova-compute[75285]:   <uuid>073785c4-a92c-4297-ab62-55c31b424ffc</uuid>
Nov 10 21:16:40 user nova-compute[75285]:   <name>instance-00000014</name>
Nov 10 21:16:40 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:16:40 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:16:40 user nova-compute[75285]:   <metadata>
Nov 10 21:16:40 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:16:40 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:16:40 user nova-compute[75285]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-252199540</nova:name>
Nov 10 21:16:40 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:16:39</nova:creationTime>
Nov 10 21:16:40 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:16:40 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:16:40 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:16:40 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:16:40 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:16:40 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:16:40 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:16:40 user nova-compute[75285]:       <nova:owner>
Nov 10 21:16:40 user nova-compute[75285]:         <nova:user uuid="51709428ae324620840611f8eb1c216f">tempest-AttachVolumeShelveTestJSON-605808320-project-member</nova:user>
Nov 10 21:16:40 user nova-compute[75285]:         <nova:project uuid="846fec1848ac4cbfa88b60ba0cf98e3c">tempest-AttachVolumeShelveTestJSON-605808320</nova:project>
Nov 10 21:16:40 user nova-compute[75285]:       </nova:owner>
Nov 10 21:16:40 user nova-compute[75285]:       <nova:root type="image" uuid="61c881d9-7940-4287-b8fa-21e2ba9d18a5"/>
Nov 10 21:16:40 user nova-compute[75285]:       <nova:ports>
Nov 10 21:16:40 user nova-compute[75285]:         <nova:port uuid="e23cea65-b47d-4daf-8640-b3617916099e">
Nov 10 21:16:40 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 21:16:40 user nova-compute[75285]:         </nova:port>
Nov 10 21:16:40 user nova-compute[75285]:       </nova:ports>
Nov 10 21:16:40 user nova-compute[75285]:     </nova:instance>
Nov 10 21:16:40 user nova-compute[75285]:   </metadata>
Nov 10 21:16:40 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:16:40 user nova-compute[75285]:     <system>
Nov 10 21:16:40 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:16:40 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:16:40 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:16:40 user nova-compute[75285]:       <entry name="serial">073785c4-a92c-4297-ab62-55c31b424ffc</entry>
Nov 10 21:16:40 user nova-compute[75285]:       <entry name="uuid">073785c4-a92c-4297-ab62-55c31b424ffc</entry>
Nov 10 21:16:40 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:16:40 user nova-compute[75285]:     </system>
Nov 10 21:16:40 user nova-compute[75285]:   </sysinfo>
Nov 10 21:16:40 user nova-compute[75285]:   <os>
Nov 10 21:16:40 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:16:40 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:16:40 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:16:40 user nova-compute[75285]:   </os>
Nov 10 21:16:40 user nova-compute[75285]:   <features>
Nov 10 21:16:40 user nova-compute[75285]:     <acpi/>
Nov 10 21:16:40 user nova-compute[75285]:     <apic/>
Nov 10 21:16:40 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:16:40 user nova-compute[75285]:   </features>
Nov 10 21:16:40 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:16:40 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:16:40 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:16:40 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:16:40 user nova-compute[75285]:   </clock>
Nov 10 21:16:40 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:16:40 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:16:40 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:16:40 user nova-compute[75285]:   </cpu>
Nov 10 21:16:40 user nova-compute[75285]:   <devices>
Nov 10 21:16:40 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:16:40 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:16:40 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk"/>
Nov 10 21:16:40 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:16:40 user nova-compute[75285]:     </disk>
Nov 10 21:16:40 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:16:40 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:16:40 user nova-compute[75285]:       <source dev="/dev/sdb"/>
Nov 10 21:16:40 user nova-compute[75285]:       <target dev="vdc" bus="virtio"/>
Nov 10 21:16:40 user nova-compute[75285]:       <serial>91772543-be49-49fb-9f3a-8181317c507c</serial>
Nov 10 21:16:40 user nova-compute[75285]:     </disk>
Nov 10 21:16:40 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:16:40 user nova-compute[75285]:       <mac address="fa:16:3e:5b:1e:9d"/>
Nov 10 21:16:40 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:16:40 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:16:40 user nova-compute[75285]:       <target dev="tape23cea65-b4"/>
Nov 10 21:16:40 user nova-compute[75285]:     </interface>
Nov 10 21:16:40 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:16:40 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/console.log" append="off"/>
Nov 10 21:16:40 user nova-compute[75285]:     </serial>
Nov 10 21:16:40 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:16:40 user nova-compute[75285]:     <video>
Nov 10 21:16:40 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:16:40 user nova-compute[75285]:     </video>
Nov 10 21:16:40 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:16:40 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:16:40 user nova-compute[75285]:     </rng>
Nov 10 21:16:40 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:16:40 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:16:40 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:16:40 user nova-compute[75285]:     </memballoon>
Nov 10 21:16:40 user nova-compute[75285]:   </devices>
Nov 10 21:16:40 user nova-compute[75285]: </domain>
Nov 10 21:16:40 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T21:11:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-252199540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-252199540',id=20,image_ref='61c881d9-7940-4287-b8fa-21e2ba9d18a5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1489604129',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:11:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='846fec1848ac4cbfa88b60ba0cf98e3c',ramdisk_id='',reservation_id='r-fi8ja34n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-605808320',owner_user_name='tempest-AttachVolumeShelveTestJSON-605808320-project-member',shelved_at='2023-11-10T21:13:55.669809',shelved_host='user',shelved_image_id='61c881d9-7940-4287-b8fa-21e2ba9d18a5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51709428ae324620840611f8eb1c216f',uuid=073785c4-a92c-4297-ab62-55c31b424ffc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converting VIF {"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=e23cea65-b47d-4daf-8640-b3617916099e,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape23cea65-b4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG os_vif [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=e23cea65-b47d-4daf-8640-b3617916099e,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape23cea65-b4') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad174e4e-ab96-586d-9a51-9abc44c24c84', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape23cea65-b4, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape23cea65-b4, col_values=(('qos', UUID('9a437a05-1606-4226-af35-7dedc101a069')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape23cea65-b4, col_values=(('external_ids', {'iface-id': 'e23cea65-b47d-4daf-8640-b3617916099e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:1e:9d', 'vm-uuid': '073785c4-a92c-4297-ab62-55c31b424ffc'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:40 user nova-compute[75285]: INFO os_vif [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=e23cea65-b47d-4daf-8640-b3617916099e,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape23cea65-b4')
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:16:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] No VIF found with MAC fa:16:3e:5b:1e:9d, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:16:41 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:16:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:42 user nova-compute[75285]: DEBUG nova.compute.manager [req-766e4c53-a75a-47f9-a39e-dfdc89b30082 req-4e3d345f-af36-4ab9-9c6a-c0e5b90a237e service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received event network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-766e4c53-a75a-47f9-a39e-dfdc89b30082 req-4e3d345f-af36-4ab9-9c6a-c0e5b90a237e service nova] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-766e4c53-a75a-47f9-a39e-dfdc89b30082 req-4e3d345f-af36-4ab9-9c6a-c0e5b90a237e service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-766e4c53-a75a-47f9-a39e-dfdc89b30082 req-4e3d345f-af36-4ab9-9c6a-c0e5b90a237e service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:42 user nova-compute[75285]: DEBUG nova.compute.manager [req-766e4c53-a75a-47f9-a39e-dfdc89b30082 req-4e3d345f-af36-4ab9-9c6a-c0e5b90a237e service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] No waiting events found dispatching network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:42 user nova-compute[75285]: WARNING nova.compute.manager [req-766e4c53-a75a-47f9-a39e-dfdc89b30082 req-4e3d345f-af36-4ab9-9c6a-c0e5b90a237e service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received unexpected event network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 21:16:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:43 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:16:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:16:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:16:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:16:43 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:16:44 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Updating instance_info_cache with network_info: [{"id": "e351ba01-6d16-40ea-ae88-097b9756cc70", "address": "fa:16:3e:a6:48:80", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape351ba01-6d", "ovs_interfaceid": "e351ba01-6d16-40ea-ae88-097b9756cc70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:16:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:16:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:16:44 user nova-compute[75285]: DEBUG nova.compute.manager [req-760b4b06-a715-457a-bbc1-2c80fe352b9b req-9764a5b6-1934-4b82-a9e5-a7b8f4c4b106 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received event network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:16:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-760b4b06-a715-457a-bbc1-2c80fe352b9b req-9764a5b6-1934-4b82-a9e5-a7b8f4c4b106 service nova] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-760b4b06-a715-457a-bbc1-2c80fe352b9b req-9764a5b6-1934-4b82-a9e5-a7b8f4c4b106 service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-760b4b06-a715-457a-bbc1-2c80fe352b9b req-9764a5b6-1934-4b82-a9e5-a7b8f4c4b106 service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:44 user nova-compute[75285]: DEBUG nova.compute.manager [req-760b4b06-a715-457a-bbc1-2c80fe352b9b req-9764a5b6-1934-4b82-a9e5-a7b8f4c4b106 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] No waiting events found dispatching network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:16:44 user nova-compute[75285]: WARNING nova.compute.manager [req-760b4b06-a715-457a-bbc1-2c80fe352b9b req-9764a5b6-1934-4b82-a9e5-a7b8f4c4b106 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received unexpected event network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 21:16:44 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:16:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:16:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:16:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Instance spawned successfully.
Nov 10 21:16:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:16:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-34872765-726f-4183-8b94-5d2b99945e17 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "073785c4-a92c-4297-ab62-55c31b424ffc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 61.617s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:45 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:16:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:46 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:16:46 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:16:47 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:16:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:47 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:16:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:50 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:16:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:16:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:16:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:16:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:16:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:16:52 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:16:52 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7938MB free_disk=25.077213287353516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3a0c67ef-1414-47e0-8769-c9164baf8993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 0ad7b009-e56f-48ae-8643-29abadf283a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 55399569-7ba7-4e75-9ded-1e9d6a7832d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 073785c4-a92c-4297-ab62-55c31b424ffc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ef5f5450-aef1-48f8-b2c0-617d4fb1803d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:16:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:16:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:16:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:16:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:16:53 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:16:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:17:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-44e67102-9aac-4686-9071-b24a33da384c req-e04ad3ee-c36e-4a9e-9060-57a2d7a2ee53 service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Received event network-changed-5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:17:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-44e67102-9aac-4686-9071-b24a33da384c req-e04ad3ee-c36e-4a9e-9060-57a2d7a2ee53 service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Refreshing instance network info cache due to event network-changed-5a6b57ea-fb79-4587-a514-43ffa86697b2. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:17:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-44e67102-9aac-4686-9071-b24a33da384c req-e04ad3ee-c36e-4a9e-9060-57a2d7a2ee53 service nova] Acquiring lock "refresh_cache-55399569-7ba7-4e75-9ded-1e9d6a7832d3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:17:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-44e67102-9aac-4686-9071-b24a33da384c req-e04ad3ee-c36e-4a9e-9060-57a2d7a2ee53 service nova] Acquired lock "refresh_cache-55399569-7ba7-4e75-9ded-1e9d6a7832d3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:17:00 user nova-compute[75285]: DEBUG nova.network.neutron [req-44e67102-9aac-4686-9071-b24a33da384c req-e04ad3ee-c36e-4a9e-9060-57a2d7a2ee53 service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Refreshing network info cache for port 5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG nova.objects.instance [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lazy-loading 'flavor' on Instance uuid 55399569-7ba7-4e75-9ded-1e9d6a7832d3 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:17:01 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Ignoring supplied device name: /dev/vdb
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:01 user nova-compute[75285]: INFO nova.compute.manager [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Attaching volume 3c46bfcc-e019-48fb-93ee-2657be00a702 to /dev/vdb
Nov 10 21:17:01 user nova-compute[75285]: DEBUG nova.network.neutron [req-44e67102-9aac-4686-9071-b24a33da384c req-e04ad3ee-c36e-4a9e-9060-57a2d7a2ee53 service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Updated VIF entry in instance network info cache for port 5a6b57ea-fb79-4587-a514-43ffa86697b2. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG nova.network.neutron [req-44e67102-9aac-4686-9071-b24a33da384c req-e04ad3ee-c36e-4a9e-9060-57a2d7a2ee53 service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Updating instance_info_cache with network_info: [{"id": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "address": "fa:16:3e:bf:71:70", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6b57ea-fb", "ovs_interfaceid": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-44e67102-9aac-4686-9071-b24a33da384c req-e04ad3ee-c36e-4a9e-9060-57a2d7a2ee53 service nova] Releasing lock "refresh_cache-55399569-7ba7-4e75-9ded-1e9d6a7832d3" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG os_brick.utils [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19576fa-8346-4386-99e9-a3a9aea7e015]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f6427e-92f3-4ea0-9f27-167eb3c0fe43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f87e3f4-eda8-4ffd-82a4-2b64fff89096]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d163cc-20da-4ea8-baa6-cdca87342792]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:17:01 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:17:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a4048e-2cda-48db-b797-eb2c4468a6a6]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG os_brick.utils [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:17:01 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Updating existing volume attachment record: 9dbe7f5c-9f4a-458b-a377-3384bb45bf97 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:17:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:17:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:17:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:17:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:17:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:17:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.compute.manager [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:17:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Creating image(s)
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Did not create local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Ensure instance console log exists: /opt/stack/data/nova/instances/ef5f5450-aef1-48f8-b2c0-617d4fb1803d/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Start _get_guest_xml network_info=[{"id": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "address": "fa:16:3e:ef:5a:f0", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496278-f4", "ovs_interfaceid": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '92f3f40c-6b98-4aff-9d83-24a1058877d7', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZFsAejg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef5f5450-aef1-48f8-b2c0-617d4fb1803d', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa895f68-63cb-4dad-aedf-9ac3c418b57c', 'serial': 'aa895f68-63cb-4dad-aedf-9ac3c418b57c'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:17:34 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:17:34 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZFsAejg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:17:34 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:17:34 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:17:34 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[11436252-a70a-404e-80bf-27087b79cb3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:17:34 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2fc1b7-4ebf-42b3-a5d5-adec1bc0b52f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c] added
Nov 10 21:17:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f56e501-8cc3-4c45-97f5-c41ebd4d4c02]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba29ad97-3d3c-40f6-a6e0-c662cb205e13]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZFsAejg {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZFsAejg" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a783a28b-7f62-4c1b-8c38-b21ac51ee82a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aZFsAejg'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f69009f-7f5e-4e7d-a119-dcdd65d294fc]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5169b691-4152-4d63-ad81-7456f5521ca5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:17:34 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:17:34 user nova-compute[75285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)
Nov 10 21:17:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:17:34 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:17:34 user nova-compute[75285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)
Nov 10 21:17:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c637ae8-f4d1-47a3-996c-49c858a73793]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260]
Nov 10 21:17:34 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260] successful.
Nov 10 21:17:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7d4e0b-acc2-4d86-be6e-91d8e7d308c8]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa476ca-4e07-48ac-be49-9eb2163fe5ad]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:17:34 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:17:34 user nova-compute[75285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)
Nov 10 21:17:34 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:17:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:17:34 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:17:34 user nova-compute[75285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)
Nov 10 21:17:34 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:17:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba6b5bb-5264-4746-b48d-217710ff38dc]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:34 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZFsAejg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23835636562376139', 'path': '/dev/sde'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835636562376139', 'path': '/dev/sde'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-357864862',display_name='tempest-TestVolumeBootPattern-server-357864862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-357864862',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAAoUPxLI+zueb7o2tu1JS76f604TN+uq+pfg2zYS5MbkMZtx1Ub2kBFu6OB71sTNt8tpmOHljKAgKzRpBKVdyr/VTj1zgWyamAFtpMuzpYAL+WhfMApRgNi/CTwdcWlw==',key_name='tempest-TestVolumeBootPattern-2083573923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04636b8a9e404d40a3a2bc9f63a4df8c',ramdisk_id='',reservation_id='r-y0nyw4cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1962512242',owner_user_name='tempest-TestVolumeBootPattern-1962512242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:16:36Z,user_data=None,user_id='e16c471c0875416aa0eb86d89eef3a27',uuid=ef5f5450-aef1-48f8-b2c0-617d4fb1803d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "address": "fa:16:3e:ef:5a:f0", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496278-f4", "ovs_interfaceid": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converting VIF {"id": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "address": "fa:16:3e:ef:5a:f0", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496278-f4", "ovs_interfaceid": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:5a:f0,bridge_name='br-int',has_traffic_filtering=True,id=e8496278-f4d1-49c1-9600-7cb6eb637b2a,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8496278-f4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG nova.objects.instance [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lazy-loading 'pci_devices' on Instance uuid ef5f5450-aef1-48f8-b2c0-617d4fb1803d {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:17:35 user nova-compute[75285]:   <uuid>ef5f5450-aef1-48f8-b2c0-617d4fb1803d</uuid>
Nov 10 21:17:35 user nova-compute[75285]:   <name>instance-0000001c</name>
Nov 10 21:17:35 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:17:35 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:17:35 user nova-compute[75285]:   <metadata>
Nov 10 21:17:35 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:17:35 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:17:35 user nova-compute[75285]:       <nova:name>tempest-TestVolumeBootPattern-server-357864862</nova:name>
Nov 10 21:17:35 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:17:34</nova:creationTime>
Nov 10 21:17:35 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:17:35 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:17:35 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:17:35 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:17:35 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:17:35 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:17:35 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:17:35 user nova-compute[75285]:       <nova:owner>
Nov 10 21:17:35 user nova-compute[75285]:         <nova:user uuid="e16c471c0875416aa0eb86d89eef3a27">tempest-TestVolumeBootPattern-1962512242-project-member</nova:user>
Nov 10 21:17:35 user nova-compute[75285]:         <nova:project uuid="04636b8a9e404d40a3a2bc9f63a4df8c">tempest-TestVolumeBootPattern-1962512242</nova:project>
Nov 10 21:17:35 user nova-compute[75285]:       </nova:owner>
Nov 10 21:17:35 user nova-compute[75285]:       <nova:ports>
Nov 10 21:17:35 user nova-compute[75285]:         <nova:port uuid="e8496278-f4d1-49c1-9600-7cb6eb637b2a">
Nov 10 21:17:35 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 21:17:35 user nova-compute[75285]:         </nova:port>
Nov 10 21:17:35 user nova-compute[75285]:       </nova:ports>
Nov 10 21:17:35 user nova-compute[75285]:     </nova:instance>
Nov 10 21:17:35 user nova-compute[75285]:   </metadata>
Nov 10 21:17:35 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:17:35 user nova-compute[75285]:     <system>
Nov 10 21:17:35 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:17:35 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:17:35 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:17:35 user nova-compute[75285]:       <entry name="serial">ef5f5450-aef1-48f8-b2c0-617d4fb1803d</entry>
Nov 10 21:17:35 user nova-compute[75285]:       <entry name="uuid">ef5f5450-aef1-48f8-b2c0-617d4fb1803d</entry>
Nov 10 21:17:35 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:17:35 user nova-compute[75285]:     </system>
Nov 10 21:17:35 user nova-compute[75285]:   </sysinfo>
Nov 10 21:17:35 user nova-compute[75285]:   <os>
Nov 10 21:17:35 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:17:35 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:17:35 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:17:35 user nova-compute[75285]:   </os>
Nov 10 21:17:35 user nova-compute[75285]:   <features>
Nov 10 21:17:35 user nova-compute[75285]:     <acpi/>
Nov 10 21:17:35 user nova-compute[75285]:     <apic/>
Nov 10 21:17:35 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:17:35 user nova-compute[75285]:   </features>
Nov 10 21:17:35 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:17:35 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:17:35 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:17:35 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:17:35 user nova-compute[75285]:   </clock>
Nov 10 21:17:35 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:17:35 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:17:35 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:17:35 user nova-compute[75285]:   </cpu>
Nov 10 21:17:35 user nova-compute[75285]:   <devices>
Nov 10 21:17:35 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:17:35 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:17:35 user nova-compute[75285]:       <source dev="/dev/sde"/>
Nov 10 21:17:35 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:17:35 user nova-compute[75285]:       <serial>aa895f68-63cb-4dad-aedf-9ac3c418b57c</serial>
Nov 10 21:17:35 user nova-compute[75285]:     </disk>
Nov 10 21:17:35 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:17:35 user nova-compute[75285]:       <mac address="fa:16:3e:ef:5a:f0"/>
Nov 10 21:17:35 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:17:35 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:17:35 user nova-compute[75285]:       <target dev="tape8496278-f4"/>
Nov 10 21:17:35 user nova-compute[75285]:     </interface>
Nov 10 21:17:35 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:17:35 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/ef5f5450-aef1-48f8-b2c0-617d4fb1803d/console.log" append="off"/>
Nov 10 21:17:35 user nova-compute[75285]:     </serial>
Nov 10 21:17:35 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:17:35 user nova-compute[75285]:     <video>
Nov 10 21:17:35 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:17:35 user nova-compute[75285]:     </video>
Nov 10 21:17:35 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:17:35 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:17:35 user nova-compute[75285]:     </rng>
Nov 10 21:17:35 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:17:35 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:17:35 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:17:35 user nova-compute[75285]:     </memballoon>
Nov 10 21:17:35 user nova-compute[75285]:   </devices>
Nov 10 21:17:35 user nova-compute[75285]: </domain>
Nov 10 21:17:35 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-357864862',display_name='tempest-TestVolumeBootPattern-server-357864862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-357864862',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAAoUPxLI+zueb7o2tu1JS76f604TN+uq+pfg2zYS5MbkMZtx1Ub2kBFu6OB71sTNt8tpmOHljKAgKzRpBKVdyr/VTj1zgWyamAFtpMuzpYAL+WhfMApRgNi/CTwdcWlw==',key_name='tempest-TestVolumeBootPattern-2083573923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04636b8a9e404d40a3a2bc9f63a4df8c',ramdisk_id='',reservation_id='r-y0nyw4cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1962512242',owner_user_name='tempest-TestVolumeBootPattern-1962512242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:16:36Z,user_data=None,user_id='e16c471c0875416aa0eb86d89eef3a27',uuid=ef5f5450-aef1-48f8-b2c0-617d4fb1803d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "address": "fa:16:3e:ef:5a:f0", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496278-f4", "ovs_interfaceid": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converting VIF {"id": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "address": "fa:16:3e:ef:5a:f0", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496278-f4", "ovs_interfaceid": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:5a:f0,bridge_name='br-int',has_traffic_filtering=True,id=e8496278-f4d1-49c1-9600-7cb6eb637b2a,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8496278-f4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG os_vif [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:5a:f0,bridge_name='br-int',has_traffic_filtering=True,id=e8496278-f4d1-49c1-9600-7cb6eb637b2a,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8496278-f4') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0f05971-bd65-5a00-9a97-9f47ceed72bf', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8496278-f4, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8496278-f4, col_values=(('qos', UUID('4a854f48-daa6-4eb3-b85c-22ffe0384760')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8496278-f4, col_values=(('external_ids', {'iface-id': 'e8496278-f4d1-49c1-9600-7cb6eb637b2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:5a:f0', 'vm-uuid': 'ef5f5450-aef1-48f8-b2c0-617d4fb1803d'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:35 user nova-compute[75285]: INFO os_vif [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:5a:f0,bridge_name='br-int',has_traffic_filtering=True,id=e8496278-f4d1-49c1-9600-7cb6eb637b2a,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8496278-f4')
Nov 10 21:17:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:17:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] No VIF found with MAC fa:16:3e:ef:5a:f0, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:17:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-48d3579d-6411-44e7-b59c-1c9e2fba28a9 req-8b565bd0-0508-4053-a44d-11f85e87b8b2 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-changed-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:17:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-48d3579d-6411-44e7-b59c-1c9e2fba28a9 req-8b565bd0-0508-4053-a44d-11f85e87b8b2 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Refreshing instance network info cache due to event network-changed-ea61ffb9-f415-4c97-850b-56d25719be25. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:17:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-48d3579d-6411-44e7-b59c-1c9e2fba28a9 req-8b565bd0-0508-4053-a44d-11f85e87b8b2 service nova] Acquiring lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:17:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-48d3579d-6411-44e7-b59c-1c9e2fba28a9 req-8b565bd0-0508-4053-a44d-11f85e87b8b2 service nova] Acquired lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:17:36 user nova-compute[75285]: DEBUG nova.network.neutron [req-48d3579d-6411-44e7-b59c-1c9e2fba28a9 req-8b565bd0-0508-4053-a44d-11f85e87b8b2 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Refreshing network info cache for port ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:17:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-e4e826d2-7e5f-4674-91ac-5ed1e6d2951d req-f4471606-0f65-4f46-9343-b2953b8ed235 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Received event network-vif-plugged-e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e4e826d2-7e5f-4674-91ac-5ed1e6d2951d req-f4471606-0f65-4f46-9343-b2953b8ed235 service nova] Acquiring lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e4e826d2-7e5f-4674-91ac-5ed1e6d2951d req-f4471606-0f65-4f46-9343-b2953b8ed235 service nova] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e4e826d2-7e5f-4674-91ac-5ed1e6d2951d req-f4471606-0f65-4f46-9343-b2953b8ed235 service nova] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-e4e826d2-7e5f-4674-91ac-5ed1e6d2951d req-f4471606-0f65-4f46-9343-b2953b8ed235 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] No waiting events found dispatching network-vif-plugged-e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:17:37 user nova-compute[75285]: WARNING nova.compute.manager [req-e4e826d2-7e5f-4674-91ac-5ed1e6d2951d req-f4471606-0f65-4f46-9343-b2953b8ed235 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Received unexpected event network-vif-plugged-e8496278-f4d1-49c1-9600-7cb6eb637b2a for instance with vm_state building and task_state spawning.
Nov 10 21:17:37 user nova-compute[75285]: DEBUG nova.network.neutron [req-48d3579d-6411-44e7-b59c-1c9e2fba28a9 req-8b565bd0-0508-4053-a44d-11f85e87b8b2 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Updated VIF entry in instance network info cache for port ea61ffb9-f415-4c97-850b-56d25719be25. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG nova.network.neutron [req-48d3579d-6411-44e7-b59c-1c9e2fba28a9 req-8b565bd0-0508-4053-a44d-11f85e87b8b2 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Updating instance_info_cache with network_info: [{"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-48d3579d-6411-44e7-b59c-1c9e2fba28a9 req-8b565bd0-0508-4053-a44d-11f85e87b8b2 service nova] Releasing lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:37 user nova-compute[75285]: INFO nova.compute.manager [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Detaching volume e333f9e0-5446-4abf-8485-6f02b10ae437
Nov 10 21:17:37 user nova-compute[75285]: INFO nova.virt.block_device [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Attempting to driver detach volume e333f9e0-5446-4abf-8485-6f02b10ae437 from mountpoint /dev/vdb
Nov 10 21:17:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Attempting to detach device vdb from instance 0ad7b009-e56f-48ae-8643-29abadf283a4 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:17:37 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:17:37 user nova-compute[75285]:   <source dev="/dev/sdd"/>
Nov 10 21:17:37 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:17:37 user nova-compute[75285]:   <serial>e333f9e0-5446-4abf-8485-6f02b10ae437</serial>
Nov 10 21:17:37 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:17:37 user nova-compute[75285]: </disk>
Nov 10 21:17:37 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:17:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Successfully detached device vdb from instance 0ad7b009-e56f-48ae-8643-29abadf283a4 from the persistent domain config.
Nov 10 21:17:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ad7b009-e56f-48ae-8643-29abadf283a4 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:17:37 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:17:37 user nova-compute[75285]:   <source dev="/dev/sdd"/>
Nov 10 21:17:37 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:17:37 user nova-compute[75285]:   <serial>e333f9e0-5446-4abf-8485-6f02b10ae437</serial>
Nov 10 21:17:37 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:17:37 user nova-compute[75285]: </disk>
Nov 10 21:17:37 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ad7b009-e56f-48ae-8643-29abadf283a4 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:17:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-f541b7ff-e758-483c-86ac-433a697137d8 req-944527ec-d215-4a00-9849-135ab1b0ea51 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-changed-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:17:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-f541b7ff-e758-483c-86ac-433a697137d8 req-944527ec-d215-4a00-9849-135ab1b0ea51 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Refreshing instance network info cache due to event network-changed-ea61ffb9-f415-4c97-850b-56d25719be25. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:17:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f541b7ff-e758-483c-86ac-433a697137d8 req-944527ec-d215-4a00-9849-135ab1b0ea51 service nova] Acquiring lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:17:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f541b7ff-e758-483c-86ac-433a697137d8 req-944527ec-d215-4a00-9849-135ab1b0ea51 service nova] Acquired lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:17:38 user nova-compute[75285]: DEBUG nova.network.neutron [req-f541b7ff-e758-483c-86ac-433a697137d8 req-944527ec-d215-4a00-9849-135ab1b0ea51 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Refreshing network info cache for port ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:17:39 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Instance spawned successfully.
Nov 10 21:17:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-3ec47c97-a07d-4e4a-bc81-0dcf07bc3805 req-a3a728e9-f315-457d-8153-e5796e80dc31 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Received event network-vif-plugged-e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3ec47c97-a07d-4e4a-bc81-0dcf07bc3805 req-a3a728e9-f315-457d-8153-e5796e80dc31 service nova] Acquiring lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3ec47c97-a07d-4e4a-bc81-0dcf07bc3805 req-a3a728e9-f315-457d-8153-e5796e80dc31 service nova] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3ec47c97-a07d-4e4a-bc81-0dcf07bc3805 req-a3a728e9-f315-457d-8153-e5796e80dc31 service nova] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-3ec47c97-a07d-4e4a-bc81-0dcf07bc3805 req-a3a728e9-f315-457d-8153-e5796e80dc31 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] No waiting events found dispatching network-vif-plugged-e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:17:39 user nova-compute[75285]: WARNING nova.compute.manager [req-3ec47c97-a07d-4e4a-bc81-0dcf07bc3805 req-a3a728e9-f315-457d-8153-e5796e80dc31 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Received unexpected event network-vif-plugged-e8496278-f4d1-49c1-9600-7cb6eb637b2a for instance with vm_state building and task_state spawning.
Nov 10 21:17:39 user nova-compute[75285]: DEBUG nova.network.neutron [req-f541b7ff-e758-483c-86ac-433a697137d8 req-944527ec-d215-4a00-9849-135ab1b0ea51 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Updated VIF entry in instance network info cache for port ea61ffb9-f415-4c97-850b-56d25719be25. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG nova.network.neutron [req-f541b7ff-e758-483c-86ac-433a697137d8 req-944527ec-d215-4a00-9849-135ab1b0ea51 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Updating instance_info_cache with network_info: [{"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:17:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f541b7ff-e758-483c-86ac-433a697137d8 req-944527ec-d215-4a00-9849-135ab1b0ea51 service nova] Releasing lock "refresh_cache-0ad7b009-e56f-48ae-8643-29abadf283a4" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:17:39 user nova-compute[75285]: INFO nova.compute.manager [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 10 21:17:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:17:39 user nova-compute[75285]: INFO nova.compute.manager [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Took 64.26 seconds to build instance.
Nov 10 21:17:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-cb15fd32-ba55-4d68-81c1-0072365e9f4e tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 64.385s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:43 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:17:43 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:17:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:17:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-3a0c67ef-1414-47e0-8769-c9164baf8993" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:17:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-3a0c67ef-1414-47e0-8769-c9164baf8993" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:17:43 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:17:44 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Updating instance_info_cache with network_info: [{"id": "361e6e85-04c1-41b7-8010-39456b498d6f", "address": "fa:16:3e:bd:d2:ae", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e6e85-04", "ovs_interfaceid": "361e6e85-04c1-41b7-8010-39456b498d6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:17:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-3a0c67ef-1414-47e0-8769-c9164baf8993" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:17:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:17:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leDotkNZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:17:46 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:17:46 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:17:46 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[454e8d42-1fb7-40c3-a683-3ace66fe72ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:17:46 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e945a5-35b8-4437-805d-8080a508da0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702] added
Nov 10 21:17:46 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f8dbd7-a27a-4188-9dc3-8a19f0195500]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f5b723-519a-4421-82a7-981aaf0f3eeb]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v leDotkNZ {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v leDotkNZ" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d757fa9-8c43-4db8-9c3d-01d04b04b607]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'leDotkNZ'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ffc84e-2f1d-4d04-979b-7bfe45a3c9f2]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0de361-f539-47cd-a51e-b4dcdf098165]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:17:46 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:17:46 user nova-compute[75285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)
Nov 10 21:17:46 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:17:46 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:17:46 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:17:46 user nova-compute[75285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)
Nov 10 21:17:46 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:17:46 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea99611-28f9-46b2-bf9b-8f7b828947ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702, portal: 172.16.0.220,3260]
Nov 10 21:17:46 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702, portal: 172.16.0.220,3260] successful.
Nov 10 21:17:46 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[277adc8b-a724-4afa-abe8-2021c3bc947f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[db16881c-a89d-4dca-b53b-6565064bd9da]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:17:46 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:17:46 user nova-compute[75285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)
Nov 10 21:17:46 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:17:46 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:17:46 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:17:46 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:17:46 user nova-compute[75285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)
Nov 10 21:17:46 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:17:46 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:17:46 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55a0ff3-2d58-45ba-9823-b8a758c6cf45]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:46 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:17:47 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:17:47 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:17:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:47 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:17:47 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:17:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leDotkNZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:17:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:17:47 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23337623465613339', 'path': '/dev/sdf'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:17:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337623465613339', 'path': '/dev/sdf'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:17:47 user nova-compute[75285]: DEBUG nova.objects.instance [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lazy-loading 'flavor' on Instance uuid 55399569-7ba7-4e75-9ded-1e9d6a7832d3 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:17:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:17:47 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:17:47 user nova-compute[75285]:   <source dev="/dev/sdf"/>
Nov 10 21:17:47 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:17:47 user nova-compute[75285]:   <serial>3c46bfcc-e019-48fb-93ee-2657be00a702</serial>
Nov 10 21:17:47 user nova-compute[75285]: </disk>
Nov 10 21:17:47 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:17:47 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] No VIF found with MAC fa:16:3e:bf:71:70, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-af89ac77-e4a8-40d6-8fc8-6f7dff7bccb6 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.101s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:49 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:17:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:49 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:17:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:17:50 user nova-compute[75285]: INFO nova.compute.claims [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Claim successful on node user
Nov 10 21:17:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:17:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:51 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:17:51 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:17:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.657s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:51 user nova-compute[75285]: DEBUG nova.compute.manager [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:17:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.manager [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.network.neutron [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:17:52 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:17:52 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7829MB free_disk=25.073246002197266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:52 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.manager [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.policy [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '187d346b3e1b453e8404662727b21a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e582cea01cf0449fad27fafe0f2d0b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3a0c67ef-1414-47e0-8769-c9164baf8993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 0ad7b009-e56f-48ae-8643-29abadf283a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 55399569-7ba7-4e75-9ded-1e9d6a7832d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 073785c4-a92c-4297-ab62-55c31b424ffc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ef5f5450-aef1-48f8-b2c0-617d4fb1803d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance aeb029de-eec7-4b68-904a-6bca29f2cfad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.manager [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:17:52 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Creating image(s)
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "/opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "/opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "/opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.244s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk 1073741824" returned: 0 in 0.061s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:17:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.821s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.235s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG nova.network.neutron [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Successfully created port: a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Cannot resize image /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Ensure instance console log exists: /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG nova.network.neutron [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Successfully updated port: a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "refresh_cache-aeb029de-eec7-4b68-904a-6bca29f2cfad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquired lock "refresh_cache-aeb029de-eec7-4b68-904a-6bca29f2cfad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG nova.network.neutron [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG nova.compute.manager [req-fa5e90bc-37c0-4350-98ac-ca351e0c32f0 req-d4e89a1b-5e2a-488e-8945-16b0f67e7863 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received event network-changed-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG nova.compute.manager [req-fa5e90bc-37c0-4350-98ac-ca351e0c32f0 req-d4e89a1b-5e2a-488e-8945-16b0f67e7863 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Refreshing instance network info cache due to event network-changed-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fa5e90bc-37c0-4350-98ac-ca351e0c32f0 req-d4e89a1b-5e2a-488e-8945-16b0f67e7863 service nova] Acquiring lock "refresh_cache-aeb029de-eec7-4b68-904a-6bca29f2cfad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:17:53 user nova-compute[75285]: DEBUG nova.network.neutron [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.network.neutron [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Updating instance_info_cache with network_info: [{"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Releasing lock "refresh_cache-aeb029de-eec7-4b68-904a-6bca29f2cfad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.compute.manager [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Instance network_info: |[{"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fa5e90bc-37c0-4350-98ac-ca351e0c32f0 req-d4e89a1b-5e2a-488e-8945-16b0f67e7863 service nova] Acquired lock "refresh_cache-aeb029de-eec7-4b68-904a-6bca29f2cfad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.network.neutron [req-fa5e90bc-37c0-4350-98ac-ca351e0c32f0 req-d4e89a1b-5e2a-488e-8945-16b0f67e7863 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Refreshing network info cache for port a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Start _get_guest_xml network_info=[{"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:17:54 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:17:54 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1344900563',display_name='tempest-tempest.common.compute-instance-1344900563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1344900563',id=29,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCxz8/kJz7qMuJbbL+KhjPzwEhpgkXsTZPfLxJMquouIKyOErI7tWXMR4fRwx1eDtPTfwTq81cvUjsQcmjJRTEGBLbNgsXVL83Z8Zpp2H9OVcF/7u80FuAIt3FNaKBzxw==',key_name='tempest-keypair-2088221850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-xjx70px8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:17:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=aeb029de-eec7-4b68-904a-6bca29f2cfad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=a484cc1a-32f1-4e1c-95fd-7f80c428e9f0,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa484cc1a-32') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.objects.instance [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lazy-loading 'pci_devices' on Instance uuid aeb029de-eec7-4b68-904a-6bca29f2cfad {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:17:54 user nova-compute[75285]:   <uuid>aeb029de-eec7-4b68-904a-6bca29f2cfad</uuid>
Nov 10 21:17:54 user nova-compute[75285]:   <name>instance-0000001d</name>
Nov 10 21:17:54 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:17:54 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:17:54 user nova-compute[75285]:   <metadata>
Nov 10 21:17:54 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:17:54 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:17:54 user nova-compute[75285]:       <nova:name>tempest-tempest.common.compute-instance-1344900563</nova:name>
Nov 10 21:17:54 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:17:54</nova:creationTime>
Nov 10 21:17:54 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:17:54 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:17:54 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:17:54 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:17:54 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:17:54 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:17:54 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:17:54 user nova-compute[75285]:       <nova:owner>
Nov 10 21:17:54 user nova-compute[75285]:         <nova:user uuid="187d346b3e1b453e8404662727b21a7f">tempest-ServerActionsTestOtherA-1895961867-project-member</nova:user>
Nov 10 21:17:54 user nova-compute[75285]:         <nova:project uuid="e582cea01cf0449fad27fafe0f2d0b4e">tempest-ServerActionsTestOtherA-1895961867</nova:project>
Nov 10 21:17:54 user nova-compute[75285]:       </nova:owner>
Nov 10 21:17:54 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:17:54 user nova-compute[75285]:       <nova:ports>
Nov 10 21:17:54 user nova-compute[75285]:         <nova:port uuid="a484cc1a-32f1-4e1c-95fd-7f80c428e9f0">
Nov 10 21:17:54 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 21:17:54 user nova-compute[75285]:         </nova:port>
Nov 10 21:17:54 user nova-compute[75285]:       </nova:ports>
Nov 10 21:17:54 user nova-compute[75285]:     </nova:instance>
Nov 10 21:17:54 user nova-compute[75285]:   </metadata>
Nov 10 21:17:54 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:17:54 user nova-compute[75285]:     <system>
Nov 10 21:17:54 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:17:54 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:17:54 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:17:54 user nova-compute[75285]:       <entry name="serial">aeb029de-eec7-4b68-904a-6bca29f2cfad</entry>
Nov 10 21:17:54 user nova-compute[75285]:       <entry name="uuid">aeb029de-eec7-4b68-904a-6bca29f2cfad</entry>
Nov 10 21:17:54 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:17:54 user nova-compute[75285]:     </system>
Nov 10 21:17:54 user nova-compute[75285]:   </sysinfo>
Nov 10 21:17:54 user nova-compute[75285]:   <os>
Nov 10 21:17:54 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:17:54 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:17:54 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:17:54 user nova-compute[75285]:   </os>
Nov 10 21:17:54 user nova-compute[75285]:   <features>
Nov 10 21:17:54 user nova-compute[75285]:     <acpi/>
Nov 10 21:17:54 user nova-compute[75285]:     <apic/>
Nov 10 21:17:54 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:17:54 user nova-compute[75285]:   </features>
Nov 10 21:17:54 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:17:54 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:17:54 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:17:54 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:17:54 user nova-compute[75285]:   </clock>
Nov 10 21:17:54 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:17:54 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:17:54 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:17:54 user nova-compute[75285]:   </cpu>
Nov 10 21:17:54 user nova-compute[75285]:   <devices>
Nov 10 21:17:54 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:17:54 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:17:54 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk"/>
Nov 10 21:17:54 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:17:54 user nova-compute[75285]:     </disk>
Nov 10 21:17:54 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:17:54 user nova-compute[75285]:       <mac address="fa:16:3e:b2:f9:97"/>
Nov 10 21:17:54 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:17:54 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:17:54 user nova-compute[75285]:       <target dev="tapa484cc1a-32"/>
Nov 10 21:17:54 user nova-compute[75285]:     </interface>
Nov 10 21:17:54 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:17:54 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/console.log" append="off"/>
Nov 10 21:17:54 user nova-compute[75285]:     </serial>
Nov 10 21:17:54 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:17:54 user nova-compute[75285]:     <video>
Nov 10 21:17:54 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:17:54 user nova-compute[75285]:     </video>
Nov 10 21:17:54 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:17:54 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:17:54 user nova-compute[75285]:     </rng>
Nov 10 21:17:54 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:17:54 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:17:54 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:17:54 user nova-compute[75285]:     </memballoon>
Nov 10 21:17:54 user nova-compute[75285]:   </devices>
Nov 10 21:17:54 user nova-compute[75285]: </domain>
Nov 10 21:17:54 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1344900563',display_name='tempest-tempest.common.compute-instance-1344900563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1344900563',id=29,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCxz8/kJz7qMuJbbL+KhjPzwEhpgkXsTZPfLxJMquouIKyOErI7tWXMR4fRwx1eDtPTfwTq81cvUjsQcmjJRTEGBLbNgsXVL83Z8Zpp2H9OVcF/7u80FuAIt3FNaKBzxw==',key_name='tempest-keypair-2088221850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-xjx70px8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:17:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=aeb029de-eec7-4b68-904a-6bca29f2cfad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=a484cc1a-32f1-4e1c-95fd-7f80c428e9f0,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa484cc1a-32') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG os_vif [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=a484cc1a-32f1-4e1c-95fd-7f80c428e9f0,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa484cc1a-32') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db829078-f659-5202-b634-8fed0054a17e', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa484cc1a-32, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa484cc1a-32, col_values=(('qos', UUID('a1a39a9b-b94b-4018-8c17-f982d4db09a7')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa484cc1a-32, col_values=(('external_ids', {'iface-id': 'a484cc1a-32f1-4e1c-95fd-7f80c428e9f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:f9:97', 'vm-uuid': 'aeb029de-eec7-4b68-904a-6bca29f2cfad'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:54 user nova-compute[75285]: INFO os_vif [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=a484cc1a-32f1-4e1c-95fd-7f80c428e9f0,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa484cc1a-32')
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] No VIF found with MAC fa:16:3e:b2:f9:97, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.network.neutron [req-fa5e90bc-37c0-4350-98ac-ca351e0c32f0 req-d4e89a1b-5e2a-488e-8945-16b0f67e7863 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Updated VIF entry in instance network info cache for port a484cc1a-32f1-4e1c-95fd-7f80c428e9f0. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG nova.network.neutron [req-fa5e90bc-37c0-4350-98ac-ca351e0c32f0 req-d4e89a1b-5e2a-488e-8945-16b0f67e7863 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Updating instance_info_cache with network_info: [{"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:17:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fa5e90bc-37c0-4350-98ac-ca351e0c32f0 req-d4e89a1b-5e2a-488e-8945-16b0f67e7863 service nova] Releasing lock "refresh_cache-aeb029de-eec7-4b68-904a-6bca29f2cfad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:17:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-0777cf7c-42d5-4ce7-8a34-ba1de857554d req-62474b2f-8121-4e24-a1fb-226eb16423e4 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received event network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:17:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0777cf7c-42d5-4ce7-8a34-ba1de857554d req-62474b2f-8121-4e24-a1fb-226eb16423e4 service nova] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0777cf7c-42d5-4ce7-8a34-ba1de857554d req-62474b2f-8121-4e24-a1fb-226eb16423e4 service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0777cf7c-42d5-4ce7-8a34-ba1de857554d req-62474b2f-8121-4e24-a1fb-226eb16423e4 service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-0777cf7c-42d5-4ce7-8a34-ba1de857554d req-62474b2f-8121-4e24-a1fb-226eb16423e4 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] No waiting events found dispatching network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:17:56 user nova-compute[75285]: WARNING nova.compute.manager [req-0777cf7c-42d5-4ce7-8a34-ba1de857554d req-62474b2f-8121-4e24-a1fb-226eb16423e4 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received unexpected event network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 for instance with vm_state building and task_state spawning.
Nov 10 21:17:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:17:56 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:17:56 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:17:56 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:17:57 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ad7b009-e56f-48ae-8643-29abadf283a4 is timed out.
Nov 10 21:17:57 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Successfully detached device vdb from instance 0ad7b009-e56f-48ae-8643-29abadf283a4 from the live domain config.
Nov 10 21:17:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:17:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQgSbROa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:17:57 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:17:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:17:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:17:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc6d8d4-155c-43cb-be17-7101a233ec86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:17:58 user nova-compute[75285]: No targets found.
Nov 10 21:17:58 user nova-compute[75285]: iSNS:
Nov 10 21:17:58 user nova-compute[75285]: No targets found.
Nov 10 21:17:58 user nova-compute[75285]: STATIC:
Nov 10 21:17:58 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:17:58 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:17:58 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:17:58 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c
Nov 10 21:17:58 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:17:58 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:17:58 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437
Nov 10 21:17:58 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:17:58 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:17:58 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c
Nov 10 21:17:58 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:17:58 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:17:58 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702
Nov 10 21:17:58 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:17:58 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:17:58 user nova-compute[75285]: FIRMWARE:
Nov 10 21:17:58 user nova-compute[75285]: No targets found.
Nov 10 21:17:58 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:17:58 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:17:58 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7585fc20-1604-4b91-8e80-c1cce20c698d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:17:58 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Instance spawned successfully.
Nov 10 21:17:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5584b9-96b5-44d9-8c83-ca574f16b353]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:17:58 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:17:58 user nova-compute[75285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)
Nov 10 21:17:58 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:17:58 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:17:58 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:17:58 user nova-compute[75285]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 (non-flash)
Nov 10 21:17:58 user nova-compute[75285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)
Nov 10 21:17:58 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:17:58 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:17:58 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e46c0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437'): ({'sdd'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Removing single pathed devices sdd {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[620dbd40-34e7-45cb-b8a7-9ee6962fed13]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa27fbb-b024-4368-ac59-185fb781ab3e]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Flushing IO for device /dev/sdd {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d425a28-ce3c-4fd3-bef8-04442052e682]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:58 user nova-compute[75285]: INFO nova.compute.manager [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 10 21:17:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27de92b-5203-4775-87ee-abb0f9eec9b5]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] SCSI volumes sdd have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa10d57-8e89-4abb-8588-f6f82af97e6b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-e02ae346-7a90-4cfa-ba0c-bb40af249550 req-22e2277f-25e0-41a3-8161-0a5868039c5d service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received event network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e02ae346-7a90-4cfa-ba0c-bb40af249550 req-22e2277f-25e0-41a3-8161-0a5868039c5d service nova] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e02ae346-7a90-4cfa-ba0c-bb40af249550 req-22e2277f-25e0-41a3-8161-0a5868039c5d service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e02ae346-7a90-4cfa-ba0c-bb40af249550 req-22e2277f-25e0-41a3-8161-0a5868039c5d service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-e02ae346-7a90-4cfa-ba0c-bb40af249550 req-22e2277f-25e0-41a3-8161-0a5868039c5d service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] No waiting events found dispatching network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:17:58 user nova-compute[75285]: WARNING nova.compute.manager [req-e02ae346-7a90-4cfa-ba0c-bb40af249550 req-22e2277f-25e0-41a3-8161-0a5868039c5d service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received unexpected event network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 for instance with vm_state building and task_state spawning.
Nov 10 21:17:58 user nova-compute[75285]: INFO nova.compute.manager [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Took 7.36 seconds to build instance.
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7120950-82b4-4a9d-90fb-cade30b9fabb tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.509s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8956b444-4082-47d6-a1c5-2431ced39967]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437, portal: 172.16.0.220,3260]
Nov 10 21:17:58 user nova-compute[75285]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437, portal: 172.16.0.220,3260] successful.
Nov 10 21:17:58 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e333f9e0-5446-4abf-8485-6f02b10ae437 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[97868bda-dd77-4a53-8b61-54ddc8484f3e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] <== disconnect_volume: return (347ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:17:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:17:59 user nova-compute[75285]: DEBUG nova.objects.instance [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'flavor' on Instance uuid 0ad7b009-e56f-48ae-8643-29abadf283a4 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:17:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-77178bbe-10d6-4fe5-8741-d79430855426 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.946s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:17:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "c7933247-e939-4ede-a431-e91488332000" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "c7933247-e939-4ede-a431-e91488332000" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:18:16 user nova-compute[75285]: INFO nova.compute.claims [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Claim successful on node user
Nov 10 21:18:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:18:16 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:18:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG nova.policy [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac13c724170f47368e5a395110c631b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9957f55c59044088e94338564e04092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:18:16 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Creating image(s)
Nov 10 21:18:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "/opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "/opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.167s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk 1073741824" returned: 0 in 0.045s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Successfully created port: 7f3d9d05-a605-443b-9d66-d14510aefb9a {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.224s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Cannot resize image /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Ensure instance console log exists: /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Successfully updated port: 7f3d9d05-a605-443b-9d66-d14510aefb9a {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "refresh_cache-c7933247-e939-4ede-a431-e91488332000" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquired lock "refresh_cache-c7933247-e939-4ede-a431-e91488332000" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.compute.manager [req-8a29a1cd-8330-4064-a2f4-e718b18f678d req-26f2c2d1-90ac-4787-a32e-fab786676996 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] Received event network-changed-7f3d9d05-a605-443b-9d66-d14510aefb9a {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.compute.manager [req-8a29a1cd-8330-4064-a2f4-e718b18f678d req-26f2c2d1-90ac-4787-a32e-fab786676996 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] Refreshing instance network info cache due to event network-changed-7f3d9d05-a605-443b-9d66-d14510aefb9a. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8a29a1cd-8330-4064-a2f4-e718b18f678d req-26f2c2d1-90ac-4787-a32e-fab786676996 service nova] Acquiring lock "refresh_cache-c7933247-e939-4ede-a431-e91488332000" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Updating instance_info_cache with network_info: [{"id": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "address": "fa:16:3e:5e:ca:1a", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3d9d05-a6", "ovs_interfaceid": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Releasing lock "refresh_cache-c7933247-e939-4ede-a431-e91488332000" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Instance network_info: |[{"id": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "address": "fa:16:3e:5e:ca:1a", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3d9d05-a6", "ovs_interfaceid": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8a29a1cd-8330-4064-a2f4-e718b18f678d req-26f2c2d1-90ac-4787-a32e-fab786676996 service nova] Acquired lock "refresh_cache-c7933247-e939-4ede-a431-e91488332000" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.network.neutron [req-8a29a1cd-8330-4064-a2f4-e718b18f678d req-26f2c2d1-90ac-4787-a32e-fab786676996 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] Refreshing network info cache for port 7f3d9d05-a605-443b-9d66-d14510aefb9a {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Start _get_guest_xml network_info=[{"id": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "address": "fa:16:3e:5e:ca:1a", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3d9d05-a6", "ovs_interfaceid": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:18:18 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:18:18 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1637790931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1637790931',id=30,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9957f55c59044088e94338564e04092',ramdisk_id='',reservation_id='r-v4t0n5uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-396261753',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:18:17Z,user_data=None,user_id='ac13c724170f47368e5a395110c631b7',uuid=c7933247-e939-4ede-a431-e91488332000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "address": "fa:16:3e:5e:ca:1a", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3d9d05-a6", "ovs_interfaceid": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converting VIF {"id": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "address": "fa:16:3e:5e:ca:1a", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3d9d05-a6", "ovs_interfaceid": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ca:1a,bridge_name='br-int',has_traffic_filtering=True,id=7f3d9d05-a605-443b-9d66-d14510aefb9a,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f3d9d05-a6') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.objects.instance [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'pci_devices' on Instance uuid c7933247-e939-4ede-a431-e91488332000 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:18:18 user nova-compute[75285]:   <uuid>c7933247-e939-4ede-a431-e91488332000</uuid>
Nov 10 21:18:18 user nova-compute[75285]:   <name>instance-0000001e</name>
Nov 10 21:18:18 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:18:18 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:18:18 user nova-compute[75285]:   <metadata>
Nov 10 21:18:18 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:18:18 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:18:18 user nova-compute[75285]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1637790931</nova:name>
Nov 10 21:18:18 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:18:18</nova:creationTime>
Nov 10 21:18:18 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:18:18 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:18:18 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:18:18 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:18:18 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:18:18 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:18:18 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:18:18 user nova-compute[75285]:       <nova:owner>
Nov 10 21:18:18 user nova-compute[75285]:         <nova:user uuid="ac13c724170f47368e5a395110c631b7">tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member</nova:user>
Nov 10 21:18:18 user nova-compute[75285]:         <nova:project uuid="b9957f55c59044088e94338564e04092">tempest-ServerBootFromVolumeStableRescueTest-396261753</nova:project>
Nov 10 21:18:18 user nova-compute[75285]:       </nova:owner>
Nov 10 21:18:18 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:18:18 user nova-compute[75285]:       <nova:ports>
Nov 10 21:18:18 user nova-compute[75285]:         <nova:port uuid="7f3d9d05-a605-443b-9d66-d14510aefb9a">
Nov 10 21:18:18 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 21:18:18 user nova-compute[75285]:         </nova:port>
Nov 10 21:18:18 user nova-compute[75285]:       </nova:ports>
Nov 10 21:18:18 user nova-compute[75285]:     </nova:instance>
Nov 10 21:18:18 user nova-compute[75285]:   </metadata>
Nov 10 21:18:18 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:18:18 user nova-compute[75285]:     <system>
Nov 10 21:18:18 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:18:18 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:18:18 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:18:18 user nova-compute[75285]:       <entry name="serial">c7933247-e939-4ede-a431-e91488332000</entry>
Nov 10 21:18:18 user nova-compute[75285]:       <entry name="uuid">c7933247-e939-4ede-a431-e91488332000</entry>
Nov 10 21:18:18 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:18:18 user nova-compute[75285]:     </system>
Nov 10 21:18:18 user nova-compute[75285]:   </sysinfo>
Nov 10 21:18:18 user nova-compute[75285]:   <os>
Nov 10 21:18:18 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:18:18 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:18:18 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:18:18 user nova-compute[75285]:   </os>
Nov 10 21:18:18 user nova-compute[75285]:   <features>
Nov 10 21:18:18 user nova-compute[75285]:     <acpi/>
Nov 10 21:18:18 user nova-compute[75285]:     <apic/>
Nov 10 21:18:18 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:18:18 user nova-compute[75285]:   </features>
Nov 10 21:18:18 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:18:18 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:18:18 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:18:18 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:18:18 user nova-compute[75285]:   </clock>
Nov 10 21:18:18 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:18:18 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:18:18 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:18:18 user nova-compute[75285]:   </cpu>
Nov 10 21:18:18 user nova-compute[75285]:   <devices>
Nov 10 21:18:18 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:18:18 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:18:18 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk"/>
Nov 10 21:18:18 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:18:18 user nova-compute[75285]:     </disk>
Nov 10 21:18:18 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:18:18 user nova-compute[75285]:       <mac address="fa:16:3e:5e:ca:1a"/>
Nov 10 21:18:18 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:18:18 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:18:18 user nova-compute[75285]:       <target dev="tap7f3d9d05-a6"/>
Nov 10 21:18:18 user nova-compute[75285]:     </interface>
Nov 10 21:18:18 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:18:18 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/console.log" append="off"/>
Nov 10 21:18:18 user nova-compute[75285]:     </serial>
Nov 10 21:18:18 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:18:18 user nova-compute[75285]:     <video>
Nov 10 21:18:18 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:18:18 user nova-compute[75285]:     </video>
Nov 10 21:18:18 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:18:18 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:18:18 user nova-compute[75285]:     </rng>
Nov 10 21:18:18 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:18:18 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:18:18 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:18:18 user nova-compute[75285]:     </memballoon>
Nov 10 21:18:18 user nova-compute[75285]:   </devices>
Nov 10 21:18:18 user nova-compute[75285]: </domain>
Nov 10 21:18:18 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1637790931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1637790931',id=30,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9957f55c59044088e94338564e04092',ramdisk_id='',reservation_id='r-v4t0n5uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-396261753',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:18:17Z,user_data=None,user_id='ac13c724170f47368e5a395110c631b7',uuid=c7933247-e939-4ede-a431-e91488332000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "address": "fa:16:3e:5e:ca:1a", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3d9d05-a6", "ovs_interfaceid": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converting VIF {"id": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "address": "fa:16:3e:5e:ca:1a", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3d9d05-a6", "ovs_interfaceid": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ca:1a,bridge_name='br-int',has_traffic_filtering=True,id=7f3d9d05-a605-443b-9d66-d14510aefb9a,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f3d9d05-a6') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG os_vif [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ca:1a,bridge_name='br-int',has_traffic_filtering=True,id=7f3d9d05-a605-443b-9d66-d14510aefb9a,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f3d9d05-a6') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbc8939f-4b4e-5a67-b80c-1e700e0bce1a', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f3d9d05-a6, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f3d9d05-a6, col_values=(('qos', UUID('4d166fd3-c9be-4f6b-852f-7ecda426906e')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f3d9d05-a6, col_values=(('external_ids', {'iface-id': '7f3d9d05-a605-443b-9d66-d14510aefb9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:ca:1a', 'vm-uuid': 'c7933247-e939-4ede-a431-e91488332000'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:18 user nova-compute[75285]: INFO os_vif [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ca:1a,bridge_name='br-int',has_traffic_filtering=True,id=7f3d9d05-a605-443b-9d66-d14510aefb9a,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f3d9d05-a6')
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] No VIF found with MAC fa:16:3e:5e:ca:1a, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.network.neutron [req-8a29a1cd-8330-4064-a2f4-e718b18f678d req-26f2c2d1-90ac-4787-a32e-fab786676996 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] Updated VIF entry in instance network info cache for port 7f3d9d05-a605-443b-9d66-d14510aefb9a. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG nova.network.neutron [req-8a29a1cd-8330-4064-a2f4-e718b18f678d req-26f2c2d1-90ac-4787-a32e-fab786676996 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] Updating instance_info_cache with network_info: [{"id": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "address": "fa:16:3e:5e:ca:1a", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3d9d05-a6", "ovs_interfaceid": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:18:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8a29a1cd-8330-4064-a2f4-e718b18f678d req-26f2c2d1-90ac-4787-a32e-fab786676996 service nova] Releasing lock "refresh_cache-c7933247-e939-4ede-a431-e91488332000" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:18:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:20 user nova-compute[75285]: DEBUG nova.compute.manager [req-fba85869-d7cf-4998-a9d6-06b2c46f0294 req-e2c6372e-6239-48f8-b5a3-24fb6ac2d005 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] Received event network-vif-plugged-7f3d9d05-a605-443b-9d66-d14510aefb9a {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:18:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fba85869-d7cf-4998-a9d6-06b2c46f0294 req-e2c6372e-6239-48f8-b5a3-24fb6ac2d005 service nova] Acquiring lock "c7933247-e939-4ede-a431-e91488332000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fba85869-d7cf-4998-a9d6-06b2c46f0294 req-e2c6372e-6239-48f8-b5a3-24fb6ac2d005 service nova] Lock "c7933247-e939-4ede-a431-e91488332000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fba85869-d7cf-4998-a9d6-06b2c46f0294 req-e2c6372e-6239-48f8-b5a3-24fb6ac2d005 service nova] Lock "c7933247-e939-4ede-a431-e91488332000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:20 user nova-compute[75285]: DEBUG nova.compute.manager [req-fba85869-d7cf-4998-a9d6-06b2c46f0294 req-e2c6372e-6239-48f8-b5a3-24fb6ac2d005 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] No waiting events found dispatching network-vif-plugged-7f3d9d05-a605-443b-9d66-d14510aefb9a {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:18:20 user nova-compute[75285]: WARNING nova.compute.manager [req-fba85869-d7cf-4998-a9d6-06b2c46f0294 req-e2c6372e-6239-48f8-b5a3-24fb6ac2d005 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] Received unexpected event network-vif-plugged-7f3d9d05-a605-443b-9d66-d14510aefb9a for instance with vm_state building and task_state spawning.
Nov 10 21:18:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:18:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:18:22 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: c7933247-e939-4ede-a431-e91488332000] Instance spawned successfully.
Nov 10 21:18:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:18:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:18:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:18:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:18:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:18:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:18:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:18:22 user nova-compute[75285]: INFO nova.compute.manager [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 10 21:18:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:18:22 user nova-compute[75285]: INFO nova.compute.manager [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Took 6.28 seconds to build instance.
Nov 10 21:18:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-5dfddcaa-bf52-4ea2-ae00-e578eecf3f34 req-72e51dd1-36ed-4095-bbf0-a3b97682c522 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] Received event network-vif-plugged-7f3d9d05-a605-443b-9d66-d14510aefb9a {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:18:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5dfddcaa-bf52-4ea2-ae00-e578eecf3f34 req-72e51dd1-36ed-4095-bbf0-a3b97682c522 service nova] Acquiring lock "c7933247-e939-4ede-a431-e91488332000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5dfddcaa-bf52-4ea2-ae00-e578eecf3f34 req-72e51dd1-36ed-4095-bbf0-a3b97682c522 service nova] Lock "c7933247-e939-4ede-a431-e91488332000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5dfddcaa-bf52-4ea2-ae00-e578eecf3f34 req-72e51dd1-36ed-4095-bbf0-a3b97682c522 service nova] Lock "c7933247-e939-4ede-a431-e91488332000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-5dfddcaa-bf52-4ea2-ae00-e578eecf3f34 req-72e51dd1-36ed-4095-bbf0-a3b97682c522 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] No waiting events found dispatching network-vif-plugged-7f3d9d05-a605-443b-9d66-d14510aefb9a {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:18:22 user nova-compute[75285]: WARNING nova.compute.manager [req-5dfddcaa-bf52-4ea2-ae00-e578eecf3f34 req-72e51dd1-36ed-4095-bbf0-a3b97682c522 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] Received unexpected event network-vif-plugged-7f3d9d05-a605-443b-9d66-d14510aefb9a for instance with vm_state active and task_state None.
Nov 10 21:18:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5a37f05d-7112-4c3c-ae1a-f5c6fee070c1 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "c7933247-e939-4ede-a431-e91488332000" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.427s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "073785c4-a92c-4297-ab62-55c31b424ffc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:24 user nova-compute[75285]: INFO nova.compute.manager [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Detaching volume 91772543-be49-49fb-9f3a-8181317c507c
Nov 10 21:18:24 user nova-compute[75285]: INFO nova.virt.block_device [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Attempting to driver detach volume 91772543-be49-49fb-9f3a-8181317c507c from mountpoint /dev/vdc
Nov 10 21:18:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Attempting to detach device vdc from instance 073785c4-a92c-4297-ab62-55c31b424ffc from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:18:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:18:24 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:18:24 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:18:24 user nova-compute[75285]:   <target dev="vdc" bus="virtio"/>
Nov 10 21:18:24 user nova-compute[75285]:   <serial>91772543-be49-49fb-9f3a-8181317c507c</serial>
Nov 10 21:18:24 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 21:18:24 user nova-compute[75285]: </disk>
Nov 10 21:18:24 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:18:24 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Successfully detached device vdc from instance 073785c4-a92c-4297-ab62-55c31b424ffc from the persistent domain config.
Nov 10 21:18:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 073785c4-a92c-4297-ab62-55c31b424ffc from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:18:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:18:24 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:18:24 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:18:24 user nova-compute[75285]:   <target dev="vdc" bus="virtio"/>
Nov 10 21:18:24 user nova-compute[75285]:   <serial>91772543-be49-49fb-9f3a-8181317c507c</serial>
Nov 10 21:18:24 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 21:18:24 user nova-compute[75285]: </disk>
Nov 10 21:18:24 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:18:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 073785c4-a92c-4297-ab62-55c31b424ffc {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:18:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:28 user nova-compute[75285]: INFO nova.compute.manager [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Terminating instance
Nov 10 21:18:28 user nova-compute[75285]: DEBUG nova.compute.manager [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-77ccfa82-95c8-4490-bd03-8b6cd20472dd req-f8c04e0d-ddfa-4285-90d5-39cedac75665 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-vif-unplugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-77ccfa82-95c8-4490-bd03-8b6cd20472dd req-f8c04e0d-ddfa-4285-90d5-39cedac75665 service nova] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-77ccfa82-95c8-4490-bd03-8b6cd20472dd req-f8c04e0d-ddfa-4285-90d5-39cedac75665 service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-77ccfa82-95c8-4490-bd03-8b6cd20472dd req-f8c04e0d-ddfa-4285-90d5-39cedac75665 service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-77ccfa82-95c8-4490-bd03-8b6cd20472dd req-f8c04e0d-ddfa-4285-90d5-39cedac75665 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] No waiting events found dispatching network-vif-unplugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-77ccfa82-95c8-4490-bd03-8b6cd20472dd req-f8c04e0d-ddfa-4285-90d5-39cedac75665 service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-vif-unplugged-ea61ffb9-f415-4c97-850b-56d25719be25 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:28 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Instance destroyed successfully.
Nov 10 21:18:28 user nova-compute[75285]: DEBUG nova.objects.instance [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'resources' on Instance uuid 0ad7b009-e56f-48ae-8643-29abadf283a4 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-296914162',display_name='tempest-ServerRescueNegativeTestJSON-server-296914162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-296914162',id=18,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZO1bKLdjQN9DGspd4XutMTTKdyiBAMV6FMPoy2h7xkksoFYNkPa1t1BqodYNZWKqcnnIbgjknrj76HYMDIeWcvHN/RKtVyptYqOXFGz/EWmZDGBaxg8oPRKR0yssggfA==',key_name='tempest-keypair-822010462',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:14:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44979c0f5b7d4205a0e5e0becbe714cb',ramdisk_id='',reservation_id='r-oeqrgq9r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-418662944',owner_user_name='tempest-ServerRescueNegativeTestJSON-418662944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:15:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9c20460877a428e9fa97869ba34eb04',uuid=0ad7b009-e56f-48ae-8643-29abadf283a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converting VIF {"id": "ea61ffb9-f415-4c97-850b-56d25719be25", "address": "fa:16:3e:1c:3e:8b", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea61ffb9-f4", "ovs_interfaceid": "ea61ffb9-f415-4c97-850b-56d25719be25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:3e:8b,bridge_name='br-int',has_traffic_filtering=True,id=ea61ffb9-f415-4c97-850b-56d25719be25,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea61ffb9-f4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG os_vif [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:3e:8b,bridge_name='br-int',has_traffic_filtering=True,id=ea61ffb9-f415-4c97-850b-56d25719be25,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea61ffb9-f4') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea61ffb9-f4, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01e3d81f-7e6a-4b9a-83fc-9d60d297d798) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:18:28 user nova-compute[75285]: INFO os_vif [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:3e:8b,bridge_name='br-int',has_traffic_filtering=True,id=ea61ffb9-f415-4c97-850b-56d25719be25,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea61ffb9-f4')
Nov 10 21:18:28 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Deleting instance files /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4_del
Nov 10 21:18:28 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Deletion of /opt/stack/data/nova/instances/0ad7b009-e56f-48ae-8643-29abadf283a4_del complete
Nov 10 21:18:28 user nova-compute[75285]: INFO nova.compute.manager [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 10 21:18:28 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:18:28 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:18:29 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:18:29 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Took 0.77 seconds to deallocate network for instance.
Nov 10 21:18:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:30 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:18:30 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:18:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:30 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Deleted allocations for instance 0ad7b009-e56f-48ae-8643-29abadf283a4
Nov 10 21:18:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fd446f33-04a6-44f9-9b90-644eae6e1cd5 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.239s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-f4d4e4a6-b180-4391-96a4-5ec44c6f0d66 req-a4a70bd2-57d3-4060-beea-cf4a3befb14d service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:18:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f4d4e4a6-b180-4391-96a4-5ec44c6f0d66 req-a4a70bd2-57d3-4060-beea-cf4a3befb14d service nova] Acquiring lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f4d4e4a6-b180-4391-96a4-5ec44c6f0d66 req-a4a70bd2-57d3-4060-beea-cf4a3befb14d service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f4d4e4a6-b180-4391-96a4-5ec44c6f0d66 req-a4a70bd2-57d3-4060-beea-cf4a3befb14d service nova] Lock "0ad7b009-e56f-48ae-8643-29abadf283a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-f4d4e4a6-b180-4391-96a4-5ec44c6f0d66 req-a4a70bd2-57d3-4060-beea-cf4a3befb14d service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] No waiting events found dispatching network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:18:30 user nova-compute[75285]: WARNING nova.compute.manager [req-f4d4e4a6-b180-4391-96a4-5ec44c6f0d66 req-a4a70bd2-57d3-4060-beea-cf4a3befb14d service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received unexpected event network-vif-plugged-ea61ffb9-f415-4c97-850b-56d25719be25 for instance with vm_state deleted and task_state None.
Nov 10 21:18:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-f4d4e4a6-b180-4391-96a4-5ec44c6f0d66 req-a4a70bd2-57d3-4060-beea-cf4a3befb14d service nova] [instance: 0ad7b009-e56f-48ae-8643-29abadf283a4] Received event network-vif-deleted-ea61ffb9-f415-4c97-850b-56d25719be25 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:18:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:43 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:18:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 21:18:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] There are 0 instances to clean {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 21:18:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:18:44 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 073785c4-a92c-4297-ab62-55c31b424ffc is timed out.
Nov 10 21:18:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Successfully detached device vdc from instance 073785c4-a92c-4297-ab62-55c31b424ffc from the live domain config.
Nov 10 21:18:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IYQVjhTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:18:44 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:18:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4714c5ac-0579-4174-a58b-51a057a0066e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:18:44 user nova-compute[75285]: No targets found.
Nov 10 21:18:44 user nova-compute[75285]: iSNS:
Nov 10 21:18:44 user nova-compute[75285]: No targets found.
Nov 10 21:18:44 user nova-compute[75285]: STATIC:
Nov 10 21:18:44 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:18:44 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:18:44 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:18:44 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c
Nov 10 21:18:44 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:18:44 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:18:44 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c
Nov 10 21:18:44 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:18:44 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:18:44 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702
Nov 10 21:18:44 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:18:44 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:18:44 user nova-compute[75285]: FIRMWARE:
Nov 10 21:18:44 user nova-compute[75285]: No targets found.
Nov 10 21:18:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:18:44 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:18:44 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f63472a-3e21-4482-95b0-9e7a892e66a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0bd6f5-8b94-4904-bcdd-4a5bf4753414]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:18:44 user nova-compute[75285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)
Nov 10 21:18:44 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:18:44 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:18:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:18:44 user nova-compute[75285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c (non-flash)
Nov 10 21:18:44 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:18:44 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:18:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a0427d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f4aab8-09bf-4c64-8e28-44744a97f248]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1b8701-d7ff-494f-ad63-5fc4f06d884a]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9c7191-9d9e-4dcf-8178-8dd2734ea65e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:18:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb907e45-9526-4759-beb5-f2fb491a7c1c]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[01766def-6d8c-4a2a-9e5d-37d770c4c46f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[164cd335-60a7-4527-a3ae-afef38cd7f08]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c, portal: 172.16.0.220,3260]
Nov 10 21:18:45 user nova-compute[75285]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c, portal: 172.16.0.220,3260] successful.
Nov 10 21:18:45 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91772543-be49-49fb-9f3a-8181317c507c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5672b66a-252b-4585-9e76-635b6de58065]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] <== disconnect_volume: return (330ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Updating instance_info_cache with network_info: [{"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:18:45 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:18:46 user nova-compute[75285]: DEBUG nova.objects.instance [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'flavor' on Instance uuid 073785c4-a92c-4297-ab62-55c31b424ffc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:18:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b91204a3-87f2-4ecc-a1b7-5ed1e1875953 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "073785c4-a92c-4297-ab62-55c31b424ffc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.994s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:46 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:18:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:47 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:18:47 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:18:47 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:18:48 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:18:48 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:18:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:48 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:18:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:49 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:18:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:18:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:18:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:18:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:18:53 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:18:53 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7601MB free_disk=25.033443450927734GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 62e8cc12-802e-415c-a166-4590715372c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3a0c67ef-1414-47e0-8769-c9164baf8993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 55399569-7ba7-4e75-9ded-1e9d6a7832d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 073785c4-a92c-4297-ab62-55c31b424ffc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ef5f5450-aef1-48f8-b2c0-617d4fb1803d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance aeb029de-eec7-4b68-904a-6bca29f2cfad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c7933247-e939-4ede-a431-e91488332000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing inventories for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating ProviderTree inventory for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating inventory in ProviderTree for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing aggregate associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, aggregates: None {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing trait associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.840s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:18:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:18:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:18:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:18:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:18:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:18:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances with incomplete migration  {{(pid=75285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 21:18:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:18:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_power_states {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 16f56b6b-f08d-4650-b0eb-a202662b0eb6 {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 62e8cc12-802e-415c-a166-4590715372c5 {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 32d2946b-f299-4b62-9f3b-6c00b0b8858b {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 3a0c67ef-1414-47e0-8769-c9164baf8993 {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 073785c4-a92c-4297-ab62-55c31b424ffc {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid ac0ddf13-9584-4e5d-99be-ad8feb6c532f {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 679abba8-40e6-4489-a34f-d4ae6843387b {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 55399569-7ba7-4e75-9ded-1e9d6a7832d3 {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid ef5f5450-aef1-48f8-b2c0-617d4fb1803d {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid aeb029de-eec7-4b68-904a-6bca29f2cfad {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid c7933247-e939-4ede-a431-e91488332000 {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "62e8cc12-802e-415c-a166-4590715372c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "62e8cc12-802e-415c-a166-4590715372c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "3a0c67ef-1414-47e0-8769-c9164baf8993" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "073785c4-a92c-4297-ab62-55c31b424ffc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "679abba8-40e6-4489-a34f-d4ae6843387b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "679abba8-40e6-4489-a34f-d4ae6843387b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "c7933247-e939-4ede-a431-e91488332000" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "c7933247-e939-4ede-a431-e91488332000" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "62e8cc12-802e-415c-a166-4590715372c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "073785c4-a92c-4297-ab62-55c31b424ffc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "679abba8-40e6-4489-a34f-d4ae6843387b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "c7933247-e939-4ede-a431-e91488332000" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "2fec5869-3e7f-4c56-907b-0e00727be6b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "2fec5869-3e7f-4c56-907b-0e00727be6b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG nova.compute.manager [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:19:11 user nova-compute[75285]: INFO nova.compute.claims [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Claim successful on node user
Nov 10 21:19:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG nova.compute.manager [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG nova.compute.manager [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG nova.network.neutron [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:19:11 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:19:11 user nova-compute[75285]: DEBUG nova.compute.manager [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG nova.policy [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd355e7ffc524aceb404b0dc3da858ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd29a6eea20479c817a2d10d68d474c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG nova.compute.manager [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:19:11 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Creating image(s)
Nov 10 21:19:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "/opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "/opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk 1073741824" returned: 0 in 0.048s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG nova.network.neutron [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Successfully created port: 8d058958-d4c3-467e-8749-9fed94afe30e {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Cannot resize image /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Ensure instance console log exists: /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.network.neutron [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Successfully updated port: 8d058958-d4c3-467e-8749-9fed94afe30e {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "refresh_cache-2fec5869-3e7f-4c56-907b-0e00727be6b2" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquired lock "refresh_cache-2fec5869-3e7f-4c56-907b-0e00727be6b2" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.network.neutron [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-6ee4f1b8-b9bd-4339-ad06-7eb833887fec req-17c217fc-a354-46ba-86ac-2da7295a40ab service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Received event network-changed-8d058958-d4c3-467e-8749-9fed94afe30e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-6ee4f1b8-b9bd-4339-ad06-7eb833887fec req-17c217fc-a354-46ba-86ac-2da7295a40ab service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Refreshing instance network info cache due to event network-changed-8d058958-d4c3-467e-8749-9fed94afe30e. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6ee4f1b8-b9bd-4339-ad06-7eb833887fec req-17c217fc-a354-46ba-86ac-2da7295a40ab service nova] Acquiring lock "refresh_cache-2fec5869-3e7f-4c56-907b-0e00727be6b2" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.network.neutron [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.network.neutron [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Updating instance_info_cache with network_info: [{"id": "8d058958-d4c3-467e-8749-9fed94afe30e", "address": "fa:16:3e:cf:c2:11", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d058958-d4", "ovs_interfaceid": "8d058958-d4c3-467e-8749-9fed94afe30e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Releasing lock "refresh_cache-2fec5869-3e7f-4c56-907b-0e00727be6b2" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Instance network_info: |[{"id": "8d058958-d4c3-467e-8749-9fed94afe30e", "address": "fa:16:3e:cf:c2:11", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d058958-d4", "ovs_interfaceid": "8d058958-d4c3-467e-8749-9fed94afe30e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6ee4f1b8-b9bd-4339-ad06-7eb833887fec req-17c217fc-a354-46ba-86ac-2da7295a40ab service nova] Acquired lock "refresh_cache-2fec5869-3e7f-4c56-907b-0e00727be6b2" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.network.neutron [req-6ee4f1b8-b9bd-4339-ad06-7eb833887fec req-17c217fc-a354-46ba-86ac-2da7295a40ab service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Refreshing network info cache for port 8d058958-d4c3-467e-8749-9fed94afe30e {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Start _get_guest_xml network_info=[{"id": "8d058958-d4c3-467e-8749-9fed94afe30e", "address": "fa:16:3e:cf:c2:11", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d058958-d4", "ovs_interfaceid": "8d058958-d4c3-467e-8749-9fed94afe30e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:19:13 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:19:13 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-556851745',display_name='tempest-VolumesActionsTest-instance-556851745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-556851745',id=31,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbd29a6eea20479c817a2d10d68d474c',ramdisk_id='',reservation_id='r-jrsb5fbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-115087691',owner_user_name='tempest-VolumesActionsTest-115087691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:19:12Z,user_data=None,user_id='cd355e7ffc524aceb404b0dc3da858ed',uuid=2fec5869-3e7f-4c56-907b-0e00727be6b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d058958-d4c3-467e-8749-9fed94afe30e", "address": "fa:16:3e:cf:c2:11", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d058958-d4", "ovs_interfaceid": "8d058958-d4c3-467e-8749-9fed94afe30e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Converting VIF {"id": "8d058958-d4c3-467e-8749-9fed94afe30e", "address": "fa:16:3e:cf:c2:11", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d058958-d4", "ovs_interfaceid": "8d058958-d4c3-467e-8749-9fed94afe30e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c2:11,bridge_name='br-int',has_traffic_filtering=True,id=8d058958-d4c3-467e-8749-9fed94afe30e,network=Network(bf1a11ae-8cfd-4986-985c-b8b237922d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d058958-d4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.objects.instance [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fec5869-3e7f-4c56-907b-0e00727be6b2 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:19:13 user nova-compute[75285]:   <uuid>2fec5869-3e7f-4c56-907b-0e00727be6b2</uuid>
Nov 10 21:19:13 user nova-compute[75285]:   <name>instance-0000001f</name>
Nov 10 21:19:13 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:19:13 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:19:13 user nova-compute[75285]:   <metadata>
Nov 10 21:19:13 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:19:13 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:19:13 user nova-compute[75285]:       <nova:name>tempest-VolumesActionsTest-instance-556851745</nova:name>
Nov 10 21:19:13 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:19:13</nova:creationTime>
Nov 10 21:19:13 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:19:13 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:19:13 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:19:13 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:19:13 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:19:13 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:19:13 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:19:13 user nova-compute[75285]:       <nova:owner>
Nov 10 21:19:13 user nova-compute[75285]:         <nova:user uuid="cd355e7ffc524aceb404b0dc3da858ed">tempest-VolumesActionsTest-115087691-project-member</nova:user>
Nov 10 21:19:13 user nova-compute[75285]:         <nova:project uuid="fbd29a6eea20479c817a2d10d68d474c">tempest-VolumesActionsTest-115087691</nova:project>
Nov 10 21:19:13 user nova-compute[75285]:       </nova:owner>
Nov 10 21:19:13 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:19:13 user nova-compute[75285]:       <nova:ports>
Nov 10 21:19:13 user nova-compute[75285]:         <nova:port uuid="8d058958-d4c3-467e-8749-9fed94afe30e">
Nov 10 21:19:13 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 21:19:13 user nova-compute[75285]:         </nova:port>
Nov 10 21:19:13 user nova-compute[75285]:       </nova:ports>
Nov 10 21:19:13 user nova-compute[75285]:     </nova:instance>
Nov 10 21:19:13 user nova-compute[75285]:   </metadata>
Nov 10 21:19:13 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:19:13 user nova-compute[75285]:     <system>
Nov 10 21:19:13 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:19:13 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:19:13 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:19:13 user nova-compute[75285]:       <entry name="serial">2fec5869-3e7f-4c56-907b-0e00727be6b2</entry>
Nov 10 21:19:13 user nova-compute[75285]:       <entry name="uuid">2fec5869-3e7f-4c56-907b-0e00727be6b2</entry>
Nov 10 21:19:13 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:19:13 user nova-compute[75285]:     </system>
Nov 10 21:19:13 user nova-compute[75285]:   </sysinfo>
Nov 10 21:19:13 user nova-compute[75285]:   <os>
Nov 10 21:19:13 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:19:13 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:19:13 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:19:13 user nova-compute[75285]:   </os>
Nov 10 21:19:13 user nova-compute[75285]:   <features>
Nov 10 21:19:13 user nova-compute[75285]:     <acpi/>
Nov 10 21:19:13 user nova-compute[75285]:     <apic/>
Nov 10 21:19:13 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:19:13 user nova-compute[75285]:   </features>
Nov 10 21:19:13 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:19:13 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:19:13 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:19:13 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:19:13 user nova-compute[75285]:   </clock>
Nov 10 21:19:13 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:19:13 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:19:13 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:19:13 user nova-compute[75285]:   </cpu>
Nov 10 21:19:13 user nova-compute[75285]:   <devices>
Nov 10 21:19:13 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:19:13 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:19:13 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk"/>
Nov 10 21:19:13 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:19:13 user nova-compute[75285]:     </disk>
Nov 10 21:19:13 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:19:13 user nova-compute[75285]:       <mac address="fa:16:3e:cf:c2:11"/>
Nov 10 21:19:13 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:19:13 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:19:13 user nova-compute[75285]:       <target dev="tap8d058958-d4"/>
Nov 10 21:19:13 user nova-compute[75285]:     </interface>
Nov 10 21:19:13 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:19:13 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/console.log" append="off"/>
Nov 10 21:19:13 user nova-compute[75285]:     </serial>
Nov 10 21:19:13 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:19:13 user nova-compute[75285]:     <video>
Nov 10 21:19:13 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:19:13 user nova-compute[75285]:     </video>
Nov 10 21:19:13 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:19:13 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:19:13 user nova-compute[75285]:     </rng>
Nov 10 21:19:13 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:19:13 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:19:13 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:19:13 user nova-compute[75285]:     </memballoon>
Nov 10 21:19:13 user nova-compute[75285]:   </devices>
Nov 10 21:19:13 user nova-compute[75285]: </domain>
Nov 10 21:19:13 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-556851745',display_name='tempest-VolumesActionsTest-instance-556851745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-556851745',id=31,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbd29a6eea20479c817a2d10d68d474c',ramdisk_id='',reservation_id='r-jrsb5fbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-115087691',owner_user_name='tempest-VolumesActionsTest-115087691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:19:12Z,user_data=None,user_id='cd355e7ffc524aceb404b0dc3da858ed',uuid=2fec5869-3e7f-4c56-907b-0e00727be6b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d058958-d4c3-467e-8749-9fed94afe30e", "address": "fa:16:3e:cf:c2:11", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d058958-d4", "ovs_interfaceid": "8d058958-d4c3-467e-8749-9fed94afe30e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Converting VIF {"id": "8d058958-d4c3-467e-8749-9fed94afe30e", "address": "fa:16:3e:cf:c2:11", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d058958-d4", "ovs_interfaceid": "8d058958-d4c3-467e-8749-9fed94afe30e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c2:11,bridge_name='br-int',has_traffic_filtering=True,id=8d058958-d4c3-467e-8749-9fed94afe30e,network=Network(bf1a11ae-8cfd-4986-985c-b8b237922d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d058958-d4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG os_vif [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c2:11,bridge_name='br-int',has_traffic_filtering=True,id=8d058958-d4c3-467e-8749-9fed94afe30e,network=Network(bf1a11ae-8cfd-4986-985c-b8b237922d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d058958-d4') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63495094-6a5d-5de3-8d9a-7632082a4261', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d058958-d4, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d058958-d4, col_values=(('qos', UUID('07997787-b3c8-4b71-b7ed-2c769b938758')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d058958-d4, col_values=(('external_ids', {'iface-id': '8d058958-d4c3-467e-8749-9fed94afe30e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:c2:11', 'vm-uuid': '2fec5869-3e7f-4c56-907b-0e00727be6b2'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:13 user nova-compute[75285]: INFO os_vif [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c2:11,bridge_name='br-int',has_traffic_filtering=True,id=8d058958-d4c3-467e-8749-9fed94afe30e,network=Network(bf1a11ae-8cfd-4986-985c-b8b237922d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d058958-d4')
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] No VIF found with MAC fa:16:3e:cf:c2:11, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.network.neutron [req-6ee4f1b8-b9bd-4339-ad06-7eb833887fec req-17c217fc-a354-46ba-86ac-2da7295a40ab service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Updated VIF entry in instance network info cache for port 8d058958-d4c3-467e-8749-9fed94afe30e. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG nova.network.neutron [req-6ee4f1b8-b9bd-4339-ad06-7eb833887fec req-17c217fc-a354-46ba-86ac-2da7295a40ab service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Updating instance_info_cache with network_info: [{"id": "8d058958-d4c3-467e-8749-9fed94afe30e", "address": "fa:16:3e:cf:c2:11", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d058958-d4", "ovs_interfaceid": "8d058958-d4c3-467e-8749-9fed94afe30e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:19:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6ee4f1b8-b9bd-4339-ad06-7eb833887fec req-17c217fc-a354-46ba-86ac-2da7295a40ab service nova] Releasing lock "refresh_cache-2fec5869-3e7f-4c56-907b-0e00727be6b2" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "073785c4-a92c-4297-ab62-55c31b424ffc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:14 user nova-compute[75285]: INFO nova.compute.manager [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Terminating instance
Nov 10 21:19:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-6fb09511-6cae-4265-a52f-41d1765b2ffe req-a6c6e83c-368e-4d48-8535-25df0c2be763 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received event network-vif-unplugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6fb09511-6cae-4265-a52f-41d1765b2ffe req-a6c6e83c-368e-4d48-8535-25df0c2be763 service nova] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6fb09511-6cae-4265-a52f-41d1765b2ffe req-a6c6e83c-368e-4d48-8535-25df0c2be763 service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6fb09511-6cae-4265-a52f-41d1765b2ffe req-a6c6e83c-368e-4d48-8535-25df0c2be763 service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-6fb09511-6cae-4265-a52f-41d1765b2ffe req-a6c6e83c-368e-4d48-8535-25df0c2be763 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] No waiting events found dispatching network-vif-unplugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:19:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-6fb09511-6cae-4265-a52f-41d1765b2ffe req-a6c6e83c-368e-4d48-8535-25df0c2be763 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received event network-vif-unplugged-e23cea65-b47d-4daf-8640-b3617916099e for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-07516a84-86f2-45fb-a8a9-48896e21c3e6 req-2b82b766-eebd-46f9-84d1-220e5adcc974 service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Received event network-vif-plugged-8d058958-d4c3-467e-8749-9fed94afe30e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-07516a84-86f2-45fb-a8a9-48896e21c3e6 req-2b82b766-eebd-46f9-84d1-220e5adcc974 service nova] Acquiring lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-07516a84-86f2-45fb-a8a9-48896e21c3e6 req-2b82b766-eebd-46f9-84d1-220e5adcc974 service nova] Lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-07516a84-86f2-45fb-a8a9-48896e21c3e6 req-2b82b766-eebd-46f9-84d1-220e5adcc974 service nova] Lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-07516a84-86f2-45fb-a8a9-48896e21c3e6 req-2b82b766-eebd-46f9-84d1-220e5adcc974 service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] No waiting events found dispatching network-vif-plugged-8d058958-d4c3-467e-8749-9fed94afe30e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:19:15 user nova-compute[75285]: WARNING nova.compute.manager [req-07516a84-86f2-45fb-a8a9-48896e21c3e6 req-2b82b766-eebd-46f9-84d1-220e5adcc974 service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Received unexpected event network-vif-plugged-8d058958-d4c3-467e-8749-9fed94afe30e for instance with vm_state building and task_state spawning.
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:15 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Instance destroyed successfully.
Nov 10 21:19:15 user nova-compute[75285]: DEBUG nova.objects.instance [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'resources' on Instance uuid 073785c4-a92c-4297-ab62-55c31b424ffc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T21:11:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-252199540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-252199540',id=20,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrGHdrWmXZnDobcBkLbJDGNOuNulhOQtjTZ0Td0zuu4Ik7AfZ4rcF63yRHtlxB6ukOXyIp7pnw4VEbd9lzTdIAPD9ZB8MrI5zYYtAh7DVkigItt1bjyVEFS0OXB4+k5sQ==',key_name='tempest-keypair-1489604129',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:16:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846fec1848ac4cbfa88b60ba0cf98e3c',ramdisk_id='',reservation_id='r-fi8ja34n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-605808320',owner_user_name='tempest-AttachVolumeShelveTestJSON-605808320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51709428ae324620840611f8eb1c216f',uuid=073785c4-a92c-4297-ab62-55c31b424ffc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converting VIF {"id": "e23cea65-b47d-4daf-8640-b3617916099e", "address": "fa:16:3e:5b:1e:9d", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape23cea65-b4", "ovs_interfaceid": "e23cea65-b47d-4daf-8640-b3617916099e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=e23cea65-b47d-4daf-8640-b3617916099e,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape23cea65-b4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG os_vif [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=e23cea65-b47d-4daf-8640-b3617916099e,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape23cea65-b4') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape23cea65-b4, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a437a05-1606-4226-af35-7dedc101a069) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:15 user nova-compute[75285]: INFO os_vif [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:1e:9d,bridge_name='br-int',has_traffic_filtering=True,id=e23cea65-b47d-4daf-8640-b3617916099e,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape23cea65-b4')
Nov 10 21:19:15 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Deleting instance files /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc_del
Nov 10 21:19:15 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Deletion of /opt/stack/data/nova/instances/073785c4-a92c-4297-ab62-55c31b424ffc_del complete
Nov 10 21:19:15 user nova-compute[75285]: INFO nova.compute.manager [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 10 21:19:15 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:19:15 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:19:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:16 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-c929878d-4223-4492-b488-9ec3eee11d28 req-4efc5a67-b6a7-406e-906f-3634914151d0 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Received event network-changed-e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-c929878d-4223-4492-b488-9ec3eee11d28 req-4efc5a67-b6a7-406e-906f-3634914151d0 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Refreshing instance network info cache due to event network-changed-e8496278-f4d1-49c1-9600-7cb6eb637b2a. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c929878d-4223-4492-b488-9ec3eee11d28 req-4efc5a67-b6a7-406e-906f-3634914151d0 service nova] Acquiring lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c929878d-4223-4492-b488-9ec3eee11d28 req-4efc5a67-b6a7-406e-906f-3634914151d0 service nova] Acquired lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.network.neutron [req-c929878d-4223-4492-b488-9ec3eee11d28 req-4efc5a67-b6a7-406e-906f-3634914151d0 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Refreshing network info cache for port e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:19:17 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Took 1.17 seconds to deallocate network for instance.
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-955cd5bc-f339-4fa7-af5e-a788b1b53ae9 req-60aa7a9f-e9ab-4107-8761-2a97ed775826 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received event network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-955cd5bc-f339-4fa7-af5e-a788b1b53ae9 req-60aa7a9f-e9ab-4107-8761-2a97ed775826 service nova] Acquiring lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-955cd5bc-f339-4fa7-af5e-a788b1b53ae9 req-60aa7a9f-e9ab-4107-8761-2a97ed775826 service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-955cd5bc-f339-4fa7-af5e-a788b1b53ae9 req-60aa7a9f-e9ab-4107-8761-2a97ed775826 service nova] Lock "073785c4-a92c-4297-ab62-55c31b424ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-955cd5bc-f339-4fa7-af5e-a788b1b53ae9 req-60aa7a9f-e9ab-4107-8761-2a97ed775826 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] No waiting events found dispatching network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:19:17 user nova-compute[75285]: WARNING nova.compute.manager [req-955cd5bc-f339-4fa7-af5e-a788b1b53ae9 req-60aa7a9f-e9ab-4107-8761-2a97ed775826 service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received unexpected event network-vif-plugged-e23cea65-b47d-4daf-8640-b3617916099e for instance with vm_state active and task_state deleting.
Nov 10 21:19:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-43ecc189-3e31-4e0a-9304-94a0a891d329 req-c6d42981-31d7-43b3-b094-9146240e90ab service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Received event network-vif-plugged-8d058958-d4c3-467e-8749-9fed94afe30e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-43ecc189-3e31-4e0a-9304-94a0a891d329 req-c6d42981-31d7-43b3-b094-9146240e90ab service nova] Acquiring lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-43ecc189-3e31-4e0a-9304-94a0a891d329 req-c6d42981-31d7-43b3-b094-9146240e90ab service nova] Lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-43ecc189-3e31-4e0a-9304-94a0a891d329 req-c6d42981-31d7-43b3-b094-9146240e90ab service nova] Lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-43ecc189-3e31-4e0a-9304-94a0a891d329 req-c6d42981-31d7-43b3-b094-9146240e90ab service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] No waiting events found dispatching network-vif-plugged-8d058958-d4c3-467e-8749-9fed94afe30e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:19:17 user nova-compute[75285]: WARNING nova.compute.manager [req-43ecc189-3e31-4e0a-9304-94a0a891d329 req-c6d42981-31d7-43b3-b094-9146240e90ab service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Received unexpected event network-vif-plugged-8d058958-d4c3-467e-8749-9fed94afe30e for instance with vm_state building and task_state spawning.
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.network.neutron [req-c929878d-4223-4492-b488-9ec3eee11d28 req-4efc5a67-b6a7-406e-906f-3634914151d0 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Updated VIF entry in instance network info cache for port e8496278-f4d1-49c1-9600-7cb6eb637b2a. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.network.neutron [req-c929878d-4223-4492-b488-9ec3eee11d28 req-4efc5a67-b6a7-406e-906f-3634914151d0 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Updating instance_info_cache with network_info: [{"id": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "address": "fa:16:3e:ef:5a:f0", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496278-f4", "ovs_interfaceid": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c929878d-4223-4492-b488-9ec3eee11d28 req-4efc5a67-b6a7-406e-906f-3634914151d0 service nova] Releasing lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.compute.manager [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:19:17 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Instance spawned successfully.
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:19:17 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Deleted allocations for instance 073785c4-a92c-4297-ab62-55c31b424ffc
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:19:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a0a9583f-0f6c-46f5-900b-241c38a58dc7 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "073785c4-a92c-4297-ab62-55c31b424ffc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.243s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:17 user nova-compute[75285]: INFO nova.compute.manager [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 10 21:19:17 user nova-compute[75285]: DEBUG nova.compute.manager [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:19:17 user nova-compute[75285]: INFO nova.compute.manager [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Took 6.58 seconds to build instance.
Nov 10 21:19:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-13830fa1-a61d-4b25-891d-5140036b01b9 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "2fec5869-3e7f-4c56-907b-0e00727be6b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.676s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-5bf8e809-b257-4505-aa33-fc7cd1eb1f89 req-0a54344d-e2dd-4fac-9e26-5dacaf0645cc service nova] [instance: 073785c4-a92c-4297-ab62-55c31b424ffc] Received event network-vif-deleted-e23cea65-b47d-4daf-8640-b3617916099e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:19:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-0399f2c1-7be4-47b2-a146-d4bdef69f3ca req-6979ee2c-64c8-4e1d-b4ff-7c5ad520c9c6 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received event network-changed-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:19:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-0399f2c1-7be4-47b2-a146-d4bdef69f3ca req-6979ee2c-64c8-4e1d-b4ff-7c5ad520c9c6 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Refreshing instance network info cache due to event network-changed-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:19:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0399f2c1-7be4-47b2-a146-d4bdef69f3ca req-6979ee2c-64c8-4e1d-b4ff-7c5ad520c9c6 service nova] Acquiring lock "refresh_cache-aeb029de-eec7-4b68-904a-6bca29f2cfad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:19:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0399f2c1-7be4-47b2-a146-d4bdef69f3ca req-6979ee2c-64c8-4e1d-b4ff-7c5ad520c9c6 service nova] Acquired lock "refresh_cache-aeb029de-eec7-4b68-904a-6bca29f2cfad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:19:41 user nova-compute[75285]: DEBUG nova.network.neutron [req-0399f2c1-7be4-47b2-a146-d4bdef69f3ca req-6979ee2c-64c8-4e1d-b4ff-7c5ad520c9c6 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Refreshing network info cache for port a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG nova.objects.instance [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lazy-loading 'flavor' on Instance uuid aeb029de-eec7-4b68-904a-6bca29f2cfad {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:42 user nova-compute[75285]: INFO nova.compute.manager [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Attaching volume 43c87b96-d1cb-4ee8-8509-ae86d53b3cbd to /dev/vdb
Nov 10 21:19:42 user nova-compute[75285]: DEBUG os_brick.utils [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f4bb09-0a54-4b9a-a6ff-da16de9764f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7f8c55-c941-4600-a1b4-f8b3145daa64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cbb63c-8c15-477c-a1d8-70d80e39d1a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35ec0eb-024d-4ccd-ae80-1021830ce35b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:19:42 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cf39d6-d362-4ac5-8326-06b389167fab]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG os_brick.utils [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Updating existing volume attachment record: a556d219-8c47-4a53-92c2-3a380873c47d {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG nova.network.neutron [req-0399f2c1-7be4-47b2-a146-d4bdef69f3ca req-6979ee2c-64c8-4e1d-b4ff-7c5ad520c9c6 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Updated VIF entry in instance network info cache for port a484cc1a-32f1-4e1c-95fd-7f80c428e9f0. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG nova.network.neutron [req-0399f2c1-7be4-47b2-a146-d4bdef69f3ca req-6979ee2c-64c8-4e1d-b4ff-7c5ad520c9c6 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Updating instance_info_cache with network_info: [{"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:19:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0399f2c1-7be4-47b2-a146-d4bdef69f3ca req-6979ee2c-64c8-4e1d-b4ff-7c5ad520c9c6 service nova] Releasing lock "refresh_cache-aeb029de-eec7-4b68-904a-6bca29f2cfad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "62e8cc12-802e-415c-a166-4590715372c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "62e8cc12-802e-415c-a166-4590715372c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "62e8cc12-802e-415c-a166-4590715372c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:43 user nova-compute[75285]: INFO nova.compute.manager [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Terminating instance
Nov 10 21:19:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-3416e52e-2a87-419c-b435-37499ffee9a6 req-34a9b99e-9b53-4b57-8aa1-177e17057d1f service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received event network-vif-unplugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3416e52e-2a87-419c-b435-37499ffee9a6 req-34a9b99e-9b53-4b57-8aa1-177e17057d1f service nova] Acquiring lock "62e8cc12-802e-415c-a166-4590715372c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3416e52e-2a87-419c-b435-37499ffee9a6 req-34a9b99e-9b53-4b57-8aa1-177e17057d1f service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3416e52e-2a87-419c-b435-37499ffee9a6 req-34a9b99e-9b53-4b57-8aa1-177e17057d1f service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-3416e52e-2a87-419c-b435-37499ffee9a6 req-34a9b99e-9b53-4b57-8aa1-177e17057d1f service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] No waiting events found dispatching network-vif-unplugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-3416e52e-2a87-419c-b435-37499ffee9a6 req-34a9b99e-9b53-4b57-8aa1-177e17057d1f service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received event network-vif-unplugged-87b7f663-4936-4a68-b667-7097b5b46783 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Instance destroyed successfully.
Nov 10 21:19:44 user nova-compute[75285]: DEBUG nova.objects.instance [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'resources' on Instance uuid 62e8cc12-802e-415c-a166-4590715372c5 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1706581524',display_name='tempest-ServerRescueNegativeTestJSON-server-1706581524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1706581524',id=3,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:04:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44979c0f5b7d4205a0e5e0becbe714cb',ramdisk_id='',reservation_id='r-ybxi4o1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-418662944',owner_user_name='tempest-ServerRescueNegativeTestJSON-418662944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:04:37Z,user_data=None,user_id='b9c20460877a428e9fa97869ba34eb04',uuid=62e8cc12-802e-415c-a166-4590715372c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converting VIF {"id": "87b7f663-4936-4a68-b667-7097b5b46783", "address": "fa:16:3e:32:86:43", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b7f663-49", "ovs_interfaceid": "87b7f663-4936-4a68-b667-7097b5b46783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:86:43,bridge_name='br-int',has_traffic_filtering=True,id=87b7f663-4936-4a68-b667-7097b5b46783,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b7f663-49') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG os_vif [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:86:43,bridge_name='br-int',has_traffic_filtering=True,id=87b7f663-4936-4a68-b667-7097b5b46783,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b7f663-49') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87b7f663-49, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93f9a315-44b1-474b-a79a-b2b36bba0381) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:19:44 user nova-compute[75285]: INFO os_vif [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:86:43,bridge_name='br-int',has_traffic_filtering=True,id=87b7f663-4936-4a68-b667-7097b5b46783,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b7f663-49')
Nov 10 21:19:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Deleting instance files /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5_del
Nov 10 21:19:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Deletion of /opt/stack/data/nova/instances/62e8cc12-802e-415c-a166-4590715372c5_del complete
Nov 10 21:19:44 user nova-compute[75285]: INFO nova.compute.manager [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 10 21:19:44 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 62e8cc12-802e-415c-a166-4590715372c5] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:19:44 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Took 0.49 seconds to deallocate network for instance.
Nov 10 21:19:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:45 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:19:45 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:19:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:45 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Deleted allocations for instance 62e8cc12-802e-415c-a166-4590715372c5
Nov 10 21:19:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7bc87f28-6c04-4c8a-9567-7ddf40d91524 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "62e8cc12-802e-415c-a166-4590715372c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.134s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-24e437e2-1888-4c21-af61-8323d3097e8c req-cf7b0af5-ba32-436d-9837-61f170a5582c service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received event network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:19:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-24e437e2-1888-4c21-af61-8323d3097e8c req-cf7b0af5-ba32-436d-9837-61f170a5582c service nova] Acquiring lock "62e8cc12-802e-415c-a166-4590715372c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-24e437e2-1888-4c21-af61-8323d3097e8c req-cf7b0af5-ba32-436d-9837-61f170a5582c service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-24e437e2-1888-4c21-af61-8323d3097e8c req-cf7b0af5-ba32-436d-9837-61f170a5582c service nova] Lock "62e8cc12-802e-415c-a166-4590715372c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-24e437e2-1888-4c21-af61-8323d3097e8c req-cf7b0af5-ba32-436d-9837-61f170a5582c service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] No waiting events found dispatching network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:19:45 user nova-compute[75285]: WARNING nova.compute.manager [req-24e437e2-1888-4c21-af61-8323d3097e8c req-cf7b0af5-ba32-436d-9837-61f170a5582c service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received unexpected event network-vif-plugged-87b7f663-4936-4a68-b667-7097b5b46783 for instance with vm_state deleted and task_state None.
Nov 10 21:19:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-24e437e2-1888-4c21-af61-8323d3097e8c req-cf7b0af5-ba32-436d-9837-61f170a5582c service nova] [instance: 62e8cc12-802e-415c-a166-4590715372c5] Received event network-vif-deleted-87b7f663-4936-4a68-b667-7097b5b46783 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:19:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:46 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:19:46 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:19:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:19:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:19:46 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:19:47 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updating instance_info_cache with network_info: [{"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:19:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:19:47 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:19:48 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:19:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:49 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:19:49 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:19:49 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:19:49 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:19:50 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:19:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:50 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:19:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:19:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:19:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:19:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:19:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:54 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:19:54 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7713MB free_disk=25.056873321533203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3a0c67ef-1414-47e0-8769-c9164baf8993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 55399569-7ba7-4e75-9ded-1e9d6a7832d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ef5f5450-aef1-48f8-b2c0-617d4fb1803d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance aeb029de-eec7-4b68-904a-6bca29f2cfad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c7933247-e939-4ede-a431-e91488332000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 2fec5869-3e7f-4c56-907b-0e00727be6b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:19:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:19:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:19:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "61cc694d-55cf-4492-bd5f-b65c733da4ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "61cc694d-55cf-4492-bd5f-b65c733da4ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:59 user nova-compute[75285]: DEBUG nova.compute.manager [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:19:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:19:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:19:59 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:19:59 user nova-compute[75285]: INFO nova.compute.claims [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Claim successful on node user
Nov 10 21:19:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:19:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:19:59 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG nova.network.neutron [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:20:00 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:20:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG nova.policy [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e16c471c0875416aa0eb86d89eef3a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04636b8a9e404d40a3a2bc9f63a4df8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:20:00 user nova-compute[75285]: INFO nova.virt.block_device [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Booting with volume 38e67fe5-c80f-4955-864b-23d9bd58f845 at /dev/vda
Nov 10 21:20:00 user nova-compute[75285]: DEBUG os_brick.utils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[755d0c92-31c5-4fff-8a6a-b00ea93d99ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9499f42c-1914-45ce-b9e8-5d57eee34c81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaef8ad-bee4-495d-84be-5e518557bf1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b431e4-366e-428c-90be-b683e09f83d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:20:00 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:20:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba10be1-35a9-44e2-a976-254bfe1ce9be]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG os_brick.utils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:20:00 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Updating existing volume attachment record: 6cb29837-49a7-4282-9585-2d700037449b {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:20:01 user nova-compute[75285]: DEBUG nova.network.neutron [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Successfully created port: 4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG nova.network.neutron [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Successfully updated port: 4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "refresh_cache-61cc694d-55cf-4492-bd5f-b65c733da4ba" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquired lock "refresh_cache-61cc694d-55cf-4492-bd5f-b65c733da4ba" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG nova.network.neutron [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG nova.compute.manager [req-365c60ce-6052-4b9c-94d9-a6815541f4df req-56d42034-81ce-4c20-aa42-33fbd9689846 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Received event network-changed-4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG nova.compute.manager [req-365c60ce-6052-4b9c-94d9-a6815541f4df req-56d42034-81ce-4c20-aa42-33fbd9689846 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Refreshing instance network info cache due to event network-changed-4956aff6-094a-4b0d-92f5-d270b683c547. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-365c60ce-6052-4b9c-94d9-a6815541f4df req-56d42034-81ce-4c20-aa42-33fbd9689846 service nova] Acquiring lock "refresh_cache-61cc694d-55cf-4492-bd5f-b65c733da4ba" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG nova.network.neutron [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG nova.network.neutron [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Updating instance_info_cache with network_info: [{"id": "4956aff6-094a-4b0d-92f5-d270b683c547", "address": "fa:16:3e:3e:ee:00", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4956aff6-09", "ovs_interfaceid": "4956aff6-094a-4b0d-92f5-d270b683c547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Releasing lock "refresh_cache-61cc694d-55cf-4492-bd5f-b65c733da4ba" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Instance network_info: |[{"id": "4956aff6-094a-4b0d-92f5-d270b683c547", "address": "fa:16:3e:3e:ee:00", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4956aff6-09", "ovs_interfaceid": "4956aff6-094a-4b0d-92f5-d270b683c547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-365c60ce-6052-4b9c-94d9-a6815541f4df req-56d42034-81ce-4c20-aa42-33fbd9689846 service nova] Acquired lock "refresh_cache-61cc694d-55cf-4492-bd5f-b65c733da4ba" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG nova.network.neutron [req-365c60ce-6052-4b9c-94d9-a6815541f4df req-56d42034-81ce-4c20-aa42-33fbd9689846 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Refreshing network info cache for port 4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG nova.network.neutron [req-365c60ce-6052-4b9c-94d9-a6815541f4df req-56d42034-81ce-4c20-aa42-33fbd9689846 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Updated VIF entry in instance network info cache for port 4956aff6-094a-4b0d-92f5-d270b683c547. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG nova.network.neutron [req-365c60ce-6052-4b9c-94d9-a6815541f4df req-56d42034-81ce-4c20-aa42-33fbd9689846 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Updating instance_info_cache with network_info: [{"id": "4956aff6-094a-4b0d-92f5-d270b683c547", "address": "fa:16:3e:3e:ee:00", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4956aff6-09", "ovs_interfaceid": "4956aff6-094a-4b0d-92f5-d270b683c547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:20:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-365c60ce-6052-4b9c-94d9-a6815541f4df req-56d42034-81ce-4c20-aa42-33fbd9689846 service nova] Releasing lock "refresh_cache-61cc694d-55cf-4492-bd5f-b65c733da4ba" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:20:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:20:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:07 user nova-compute[75285]: DEBUG nova.compute.manager [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:20:07 user nova-compute[75285]: INFO nova.compute.manager [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] instance snapshotting
Nov 10 21:20:07 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Beginning live snapshot process
Nov 10 21:20:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json -f qcow2 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json -f qcow2 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuf5gh6zt/586a89af082c43f0a73f01aca699b785.delta 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuf5gh6zt/586a89af082c43f0a73f01aca699b785.delta 1073741824" returned: 0 in 0.053s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:08 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 21:20:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "63869b5c-443c-4bc6-ac63-f3b559290917" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "63869b5c-443c-4bc6-ac63-f3b559290917" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:20:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:08 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:20:08 user nova-compute[75285]: INFO nova.compute.claims [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Claim successful on node user
Nov 10 21:20:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIXdgROa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:20:09 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:20:09 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:20:09 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.590s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de48126-dd82-4b4a-8d99-563c19b8255b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:20:09 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6763fe-6625-433b-8dd8-c88d0ae3aa51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd] added
Nov 10 21:20:09 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3327b109-fc81-4d36-8770-2cb97c3c1216]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:09 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fa6d8f-a638-4a01-9201-c2a0022da093]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YIXdgROa {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YIXdgROa" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4943d930-30aa-470f-a480-0e75366a06f5]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YIXdgROa'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[da97a764-efde-4ff8-9e90-ecf61e3dc29e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd15767-3a07-4975-8f6f-22ab14d5e6c7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:09 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:09 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:20:09 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:09 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:09 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:20:09 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG nova.policy [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51709428ae324620840611f8eb1c216f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846fec1848ac4cbfa88b60ba0cf98e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:20:09 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Creating image(s)
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "/opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "/opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "/opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2471c1d8-ecf8-4aad-85f1-8c4c8e505a1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260]
Nov 10 21:20:09 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260] successful.
Nov 10 21:20:09 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a43c071-a981-47b6-8008-12d88349c64a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:09 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58265a0-c224-4615-a6b8-bd795a0e37cc]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:09 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:09 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:20:09 user nova-compute[75285]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:20:09 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:09 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:09 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:20:09 user nova-compute[75285]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:20:09 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adf6475-433d-4fcd-825c-b3451a6493bc]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuf5gh6zt/586a89af082c43f0a73f01aca699b785.delta /opt/stack/data/nova/instances/snapshots/tmpuf5gh6zt/586a89af082c43f0a73f01aca699b785 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.201s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuf5gh6zt/586a89af082c43f0a73f01aca699b785.delta /opt/stack/data/nova/instances/snapshots/tmpuf5gh6zt/586a89af082c43f0a73f01aca699b785" returned: 0 in 0.287s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:10 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Snapshot extracted, beginning image upload
Nov 10 21:20:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk 1073741824" returned: 0 in 0.071s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Successfully created port: a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Cannot resize image /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Ensure instance console log exists: /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIXdgROa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26463626663613038', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463626663613038', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG nova.objects.instance [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lazy-loading 'flavor' on Instance uuid aeb029de-eec7-4b68-904a-6bca29f2cfad {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:20:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:20:10 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:20:10 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:20:10 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:20:10 user nova-compute[75285]:   <serial>43c87b96-d1cb-4ee8-8509-ae86d53b3cbd</serial>
Nov 10 21:20:10 user nova-compute[75285]: </disk>
Nov 10 21:20:10 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Successfully updated port: a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquired lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.compute.manager [req-7f0ca6bd-ee43-441a-b997-5ce618f760be req-0401579a-495a-4de3-8ec4-b2e1f1af5416 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received event network-changed-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.compute.manager [req-7f0ca6bd-ee43-441a-b997-5ce618f760be req-0401579a-495a-4de3-8ec4-b2e1f1af5416 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Refreshing instance network info cache due to event network-changed-a027d49a-f9ca-43fa-af0c-e62afd4e83dc. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7f0ca6bd-ee43-441a-b997-5ce618f760be req-0401579a-495a-4de3-8ec4-b2e1f1af5416 service nova] Acquiring lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] No VIF found with MAC fa:16:3e:b2:f9:97, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-4133df3b-682e-4e0b-819d-1d47009eaba0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.869s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updating instance_info_cache with network_info: [{"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Releasing lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Instance network_info: |[{"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7f0ca6bd-ee43-441a-b997-5ce618f760be req-0401579a-495a-4de3-8ec4-b2e1f1af5416 service nova] Acquired lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.network.neutron [req-7f0ca6bd-ee43-441a-b997-5ce618f760be req-0401579a-495a-4de3-8ec4-b2e1f1af5416 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Refreshing network info cache for port a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Start _get_guest_xml network_info=[{"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:20:11 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:20:11 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1135169646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1135169646',id=33,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOTmSqMrfpP4ULBanEmWMIdP/tUpnj4KxwB/AchH+gg4U4S6VjblHfoc+guFOqXeQ9rQFe188DGGYwHi79Xd8dRCfeGh48ucZKaIkvMUU+jkvwLrmTx5ZXfkMjaKFtu2A==',key_name='tempest-keypair-153817456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846fec1848ac4cbfa88b60ba0cf98e3c',ramdisk_id='',reservation_id='r-46g8atv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-605808320',owner_user_name='tempest-AttachVolumeShelveTestJSON-605808320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51709428ae324620840611f8eb1c216f',uuid=63869b5c-443c-4bc6-ac63-f3b559290917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converting VIF {"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:f9,bridge_name='br-int',has_traffic_filtering=True,id=a027d49a-f9ca-43fa-af0c-e62afd4e83dc,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa027d49a-f9') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'pci_devices' on Instance uuid 63869b5c-443c-4bc6-ac63-f3b559290917 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:20:11 user nova-compute[75285]:   <uuid>63869b5c-443c-4bc6-ac63-f3b559290917</uuid>
Nov 10 21:20:11 user nova-compute[75285]:   <name>instance-00000021</name>
Nov 10 21:20:11 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:20:11 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:20:11 user nova-compute[75285]:   <metadata>
Nov 10 21:20:11 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:20:11 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:20:11 user nova-compute[75285]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1135169646</nova:name>
Nov 10 21:20:11 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:20:11</nova:creationTime>
Nov 10 21:20:11 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:20:11 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:20:11 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:20:11 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:20:11 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:20:11 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:20:11 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:20:11 user nova-compute[75285]:       <nova:owner>
Nov 10 21:20:11 user nova-compute[75285]:         <nova:user uuid="51709428ae324620840611f8eb1c216f">tempest-AttachVolumeShelveTestJSON-605808320-project-member</nova:user>
Nov 10 21:20:11 user nova-compute[75285]:         <nova:project uuid="846fec1848ac4cbfa88b60ba0cf98e3c">tempest-AttachVolumeShelveTestJSON-605808320</nova:project>
Nov 10 21:20:11 user nova-compute[75285]:       </nova:owner>
Nov 10 21:20:11 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:20:11 user nova-compute[75285]:       <nova:ports>
Nov 10 21:20:11 user nova-compute[75285]:         <nova:port uuid="a027d49a-f9ca-43fa-af0c-e62afd4e83dc">
Nov 10 21:20:11 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 21:20:11 user nova-compute[75285]:         </nova:port>
Nov 10 21:20:11 user nova-compute[75285]:       </nova:ports>
Nov 10 21:20:11 user nova-compute[75285]:     </nova:instance>
Nov 10 21:20:11 user nova-compute[75285]:   </metadata>
Nov 10 21:20:11 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:20:11 user nova-compute[75285]:     <system>
Nov 10 21:20:11 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:20:11 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:20:11 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:20:11 user nova-compute[75285]:       <entry name="serial">63869b5c-443c-4bc6-ac63-f3b559290917</entry>
Nov 10 21:20:11 user nova-compute[75285]:       <entry name="uuid">63869b5c-443c-4bc6-ac63-f3b559290917</entry>
Nov 10 21:20:11 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:20:11 user nova-compute[75285]:     </system>
Nov 10 21:20:11 user nova-compute[75285]:   </sysinfo>
Nov 10 21:20:11 user nova-compute[75285]:   <os>
Nov 10 21:20:11 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:20:11 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:20:11 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:20:11 user nova-compute[75285]:   </os>
Nov 10 21:20:11 user nova-compute[75285]:   <features>
Nov 10 21:20:11 user nova-compute[75285]:     <acpi/>
Nov 10 21:20:11 user nova-compute[75285]:     <apic/>
Nov 10 21:20:11 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:20:11 user nova-compute[75285]:   </features>
Nov 10 21:20:11 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:20:11 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:20:11 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:20:11 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:20:11 user nova-compute[75285]:   </clock>
Nov 10 21:20:11 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:20:11 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:20:11 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:20:11 user nova-compute[75285]:   </cpu>
Nov 10 21:20:11 user nova-compute[75285]:   <devices>
Nov 10 21:20:11 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:20:11 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:20:11 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk"/>
Nov 10 21:20:11 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:20:11 user nova-compute[75285]:     </disk>
Nov 10 21:20:11 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:20:11 user nova-compute[75285]:       <mac address="fa:16:3e:ae:2d:f9"/>
Nov 10 21:20:11 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:20:11 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:20:11 user nova-compute[75285]:       <target dev="tapa027d49a-f9"/>
Nov 10 21:20:11 user nova-compute[75285]:     </interface>
Nov 10 21:20:11 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:20:11 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/console.log" append="off"/>
Nov 10 21:20:11 user nova-compute[75285]:     </serial>
Nov 10 21:20:11 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:20:11 user nova-compute[75285]:     <video>
Nov 10 21:20:11 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:20:11 user nova-compute[75285]:     </video>
Nov 10 21:20:11 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:20:11 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:20:11 user nova-compute[75285]:     </rng>
Nov 10 21:20:11 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:20:11 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:20:11 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:20:11 user nova-compute[75285]:     </memballoon>
Nov 10 21:20:11 user nova-compute[75285]:   </devices>
Nov 10 21:20:11 user nova-compute[75285]: </domain>
Nov 10 21:20:11 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1135169646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1135169646',id=33,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOTmSqMrfpP4ULBanEmWMIdP/tUpnj4KxwB/AchH+gg4U4S6VjblHfoc+guFOqXeQ9rQFe188DGGYwHi79Xd8dRCfeGh48ucZKaIkvMUU+jkvwLrmTx5ZXfkMjaKFtu2A==',key_name='tempest-keypair-153817456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846fec1848ac4cbfa88b60ba0cf98e3c',ramdisk_id='',reservation_id='r-46g8atv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-605808320',owner_user_name='tempest-AttachVolumeShelveTestJSON-605808320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51709428ae324620840611f8eb1c216f',uuid=63869b5c-443c-4bc6-ac63-f3b559290917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converting VIF {"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:f9,bridge_name='br-int',has_traffic_filtering=True,id=a027d49a-f9ca-43fa-af0c-e62afd4e83dc,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa027d49a-f9') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG os_vif [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:f9,bridge_name='br-int',has_traffic_filtering=True,id=a027d49a-f9ca-43fa-af0c-e62afd4e83dc,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa027d49a-f9') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34c2bb76-e230-59da-af60-78645fe852b9', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa027d49a-f9, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa027d49a-f9, col_values=(('qos', UUID('f84c8378-e49e-421e-9146-2e9743dfc6a1')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa027d49a-f9, col_values=(('external_ids', {'iface-id': 'a027d49a-f9ca-43fa-af0c-e62afd4e83dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:2d:f9', 'vm-uuid': '63869b5c-443c-4bc6-ac63-f3b559290917'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:11 user nova-compute[75285]: INFO os_vif [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:f9,bridge_name='br-int',has_traffic_filtering=True,id=a027d49a-f9ca-43fa-af0c-e62afd4e83dc,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa027d49a-f9')
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:20:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] No VIF found with MAC fa:16:3e:ae:2d:f9, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:20:12 user nova-compute[75285]: DEBUG nova.network.neutron [req-7f0ca6bd-ee43-441a-b997-5ce618f760be req-0401579a-495a-4de3-8ec4-b2e1f1af5416 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updated VIF entry in instance network info cache for port a027d49a-f9ca-43fa-af0c-e62afd4e83dc. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:20:12 user nova-compute[75285]: DEBUG nova.network.neutron [req-7f0ca6bd-ee43-441a-b997-5ce618f760be req-0401579a-495a-4de3-8ec4-b2e1f1af5416 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updating instance_info_cache with network_info: [{"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:20:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7f0ca6bd-ee43-441a-b997-5ce618f760be req-0401579a-495a-4de3-8ec4-b2e1f1af5416 service nova] Releasing lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:20:12 user nova-compute[75285]: INFO nova.compute.manager [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Rebuilding instance
Nov 10 21:20:12 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:20:13 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Snapshot image upload complete
Nov 10 21:20:13 user nova-compute[75285]: INFO nova.compute.manager [None req-1d7ef57e-58aa-4497-99ed-be731662ef29 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Took 5.44 seconds to snapshot the instance on the hypervisor.
Nov 10 21:20:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-3fe4a916-a7d4-4910-bbb5-0728f92f6f28 req-00197dc4-e60f-456f-a09c-2188145085b1 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received event network-vif-unplugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3fe4a916-a7d4-4910-bbb5-0728f92f6f28 req-00197dc4-e60f-456f-a09c-2188145085b1 service nova] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3fe4a916-a7d4-4910-bbb5-0728f92f6f28 req-00197dc4-e60f-456f-a09c-2188145085b1 service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3fe4a916-a7d4-4910-bbb5-0728f92f6f28 req-00197dc4-e60f-456f-a09c-2188145085b1 service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-3fe4a916-a7d4-4910-bbb5-0728f92f6f28 req-00197dc4-e60f-456f-a09c-2188145085b1 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] No waiting events found dispatching network-vif-unplugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:20:13 user nova-compute[75285]: WARNING nova.compute.manager [req-3fe4a916-a7d4-4910-bbb5-0728f92f6f28 req-00197dc4-e60f-456f-a09c-2188145085b1 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received unexpected event network-vif-unplugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 for instance with vm_state active and task_state rebuilding.
Nov 10 21:20:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-568d0c54-b585-4952-987d-fd81469f7f59 req-a541d84e-33a0-4512-9bbf-a6f2fa4c3b39 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received event network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-568d0c54-b585-4952-987d-fd81469f7f59 req-a541d84e-33a0-4512-9bbf-a6f2fa4c3b39 service nova] Acquiring lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-568d0c54-b585-4952-987d-fd81469f7f59 req-a541d84e-33a0-4512-9bbf-a6f2fa4c3b39 service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-568d0c54-b585-4952-987d-fd81469f7f59 req-a541d84e-33a0-4512-9bbf-a6f2fa4c3b39 service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-568d0c54-b585-4952-987d-fd81469f7f59 req-a541d84e-33a0-4512-9bbf-a6f2fa4c3b39 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] No waiting events found dispatching network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:20:13 user nova-compute[75285]: WARNING nova.compute.manager [req-568d0c54-b585-4952-987d-fd81469f7f59 req-a541d84e-33a0-4512-9bbf-a6f2fa4c3b39 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received unexpected event network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc for instance with vm_state building and task_state spawning.
Nov 10 21:20:13 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Instance destroyed successfully.
Nov 10 21:20:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:14 user nova-compute[75285]: INFO nova.compute.manager [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Detaching volume 43c87b96-d1cb-4ee8-8509-ae86d53b3cbd
Nov 10 21:20:14 user nova-compute[75285]: INFO nova.virt.block_device [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Attempting to driver detach volume 43c87b96-d1cb-4ee8-8509-ae86d53b3cbd from mountpoint /dev/vdb
Nov 10 21:20:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Attempting to detach device vdb from instance aeb029de-eec7-4b68-904a-6bca29f2cfad from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:20:14 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:20:14 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:20:14 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:20:14 user nova-compute[75285]:   <serial>43c87b96-d1cb-4ee8-8509-ae86d53b3cbd</serial>
Nov 10 21:20:14 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:20:14 user nova-compute[75285]: </disk>
Nov 10 21:20:14 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:20:14 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Successfully detached device vdb from instance aeb029de-eec7-4b68-904a-6bca29f2cfad from the persistent domain config.
Nov 10 21:20:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIXdgROa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:20:14 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f76401-fce8-428d-b0dd-c7189160d739]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:20:14 user nova-compute[75285]: No targets found.
Nov 10 21:20:14 user nova-compute[75285]: iSNS:
Nov 10 21:20:14 user nova-compute[75285]: No targets found.
Nov 10 21:20:14 user nova-compute[75285]: STATIC:
Nov 10 21:20:14 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:20:14 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:20:14 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:20:14 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c
Nov 10 21:20:14 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:20:14 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:20:14 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd
Nov 10 21:20:14 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:20:14 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:20:14 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702
Nov 10 21:20:14 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:20:14 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:20:14 user nova-compute[75285]: FIRMWARE:
Nov 10 21:20:14 user nova-compute[75285]: No targets found.
Nov 10 21:20:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:20:14 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:20:14 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6028a8c-5177-4f5e-824c-8ea169173fb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[063e3e17-5c9a-449c-86c1-3a398a22068c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:14 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:14 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:20:14 user nova-compute[75285]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:20:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:14 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:14 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:20:14 user nova-compute[75285]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:20:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a04104040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e18f6fb-282d-48a4-a0ac-b9c6fc30f579]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[37df6174-a22b-4acd-8c7a-8e90c77b20d4]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3386ef-a9e3-4e24-aa87-8bd6f4dad1a0]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd2d006-bd24-439d-b01e-01a139bcd88c]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f2020d-3563-4fd9-9fbd-4fe8425328f7]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7aa88c-1a85-441b-adac-0f2aefc2716d]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260]
Nov 10 21:20:14 user nova-compute[75285]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260] successful.
Nov 10 21:20:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[438b07d6-ef27-46e0-812c-7f430c368adc]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] <== disconnect_volume: return (316ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:20:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-1929da31-0016-4865-8965-a840420704e3 req-a8f25df6-9431-47b2-ad06-706a56d4f17e service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received event network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1929da31-0016-4865-8965-a840420704e3 req-a8f25df6-9431-47b2-ad06-706a56d4f17e service nova] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1929da31-0016-4865-8965-a840420704e3 req-a8f25df6-9431-47b2-ad06-706a56d4f17e service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1929da31-0016-4865-8965-a840420704e3 req-a8f25df6-9431-47b2-ad06-706a56d4f17e service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-1929da31-0016-4865-8965-a840420704e3 req-a8f25df6-9431-47b2-ad06-706a56d4f17e service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] No waiting events found dispatching network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:20:15 user nova-compute[75285]: WARNING nova.compute.manager [req-1929da31-0016-4865-8965-a840420704e3 req-a8f25df6-9431-47b2-ad06-706a56d4f17e service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received unexpected event network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 for instance with vm_state active and task_state rebuilding.
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-f998f1a3-78f9-49f5-9253-735d4f972ba2 req-e3bfe7b6-724b-4690-ba13-0210c8e38cfd service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received event network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f998f1a3-78f9-49f5-9253-735d4f972ba2 req-e3bfe7b6-724b-4690-ba13-0210c8e38cfd service nova] Acquiring lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f998f1a3-78f9-49f5-9253-735d4f972ba2 req-e3bfe7b6-724b-4690-ba13-0210c8e38cfd service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f998f1a3-78f9-49f5-9253-735d4f972ba2 req-e3bfe7b6-724b-4690-ba13-0210c8e38cfd service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-f998f1a3-78f9-49f5-9253-735d4f972ba2 req-e3bfe7b6-724b-4690-ba13-0210c8e38cfd service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] No waiting events found dispatching network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:20:15 user nova-compute[75285]: WARNING nova.compute.manager [req-f998f1a3-78f9-49f5-9253-735d4f972ba2 req-e3bfe7b6-724b-4690-ba13-0210c8e38cfd service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received unexpected event network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc for instance with vm_state building and task_state spawning.
Nov 10 21:20:15 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Instance destroyed successfully.
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1344900563',display_name='tempest-ServerActionsTestOtherA-server-27154683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1344900563',id=29,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCxz8/kJz7qMuJbbL+KhjPzwEhpgkXsTZPfLxJMquouIKyOErI7tWXMR4fRwx1eDtPTfwTq81cvUjsQcmjJRTEGBLbNgsXVL83Z8Zpp2H9OVcF/7u80FuAIt3FNaKBzxw==',key_name='tempest-keypair-2088221850',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-xjx70px8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:20:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=aeb029de-eec7-4b68-904a-6bca29f2cfad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=a484cc1a-32f1-4e1c-95fd-7f80c428e9f0,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa484cc1a-32') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG os_vif [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=a484cc1a-32f1-4e1c-95fd-7f80c428e9f0,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa484cc1a-32') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa484cc1a-32, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1a39a9b-b94b-4018-8c17-f982d4db09a7) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:20:15 user nova-compute[75285]: INFO os_vif [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=a484cc1a-32f1-4e1c-95fd-7f80c428e9f0,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa484cc1a-32')
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIXdgROa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:20:15 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 21:20:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d95de9-c2d4-4076-8b27-2b44a851290f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:20:15 user nova-compute[75285]: No targets found.
Nov 10 21:20:15 user nova-compute[75285]: iSNS:
Nov 10 21:20:15 user nova-compute[75285]: No targets found.
Nov 10 21:20:15 user nova-compute[75285]: STATIC:
Nov 10 21:20:15 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:20:15 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:20:15 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:20:15 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c
Nov 10 21:20:15 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:20:15 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:20:15 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702
Nov 10 21:20:15 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:20:15 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:20:15 user nova-compute[75285]: FIRMWARE:
Nov 10 21:20:15 user nova-compute[75285]: No targets found.
Nov 10 21:20:15 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:20:15 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:20:15 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3eb777-1f03-4f3f-af65-71cd37cf8eaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9a6072-6b95-45a2-89df-fce9ebc0a9d6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:15 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:15 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:20:15 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:15 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:15 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:20:15 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a041a0790>, {}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Disconnecting from: [] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] <== disconnect_volume: return (76ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:20:15 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Deleting instance files /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad_del
Nov 10 21:20:15 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Deletion of /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad_del complete
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:20:15 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Instance spawned successfully.
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:20:15 user nova-compute[75285]: INFO nova.virt.block_device [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Booting with volume 43c87b96-d1cb-4ee8-8509-ae86d53b3cbd at /dev/vdb
Nov 10 21:20:15 user nova-compute[75285]: INFO nova.compute.manager [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 10 21:20:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG os_brick.utils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[36747d4d-b8c7-4bf5-a935-fe835cd58d24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:15 user nova-compute[75285]: INFO nova.compute.manager [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Took 7.13 seconds to build instance.
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e1ab06-718b-4433-910a-19a9cf8e73f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2360a112-ca60-42fc-9d2b-34967ac56f5d tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "63869b5c-443c-4bc6-ac63-f3b559290917" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.239s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10f0141-6a11-409f-9edb-05949821b988]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4fba22-cf6c-4cdf-861e-9efbb726c7df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:20:16 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:20:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae081b2-e836-4c33-a771-a5d80cf5b950]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG os_brick.utils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Updating existing volume attachment record: 18f08415-3be3-4de6-88c5-fbd654f823bc {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:20:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "3a0c67ef-1414-47e0-8769-c9164baf8993" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:21 user nova-compute[75285]: INFO nova.compute.manager [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Terminating instance
Nov 10 21:20:21 user nova-compute[75285]: DEBUG nova.compute.manager [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:20:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-5dc2a682-5b79-4025-b39f-cd127b0e0af5 req-31bb8cb4-75a2-44b1-baed-8228eb5f4b45 service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Received event network-vif-unplugged-361e6e85-04c1-41b7-8010-39456b498d6f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5dc2a682-5b79-4025-b39f-cd127b0e0af5 req-31bb8cb4-75a2-44b1-baed-8228eb5f4b45 service nova] Acquiring lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5dc2a682-5b79-4025-b39f-cd127b0e0af5 req-31bb8cb4-75a2-44b1-baed-8228eb5f4b45 service nova] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5dc2a682-5b79-4025-b39f-cd127b0e0af5 req-31bb8cb4-75a2-44b1-baed-8228eb5f4b45 service nova] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-5dc2a682-5b79-4025-b39f-cd127b0e0af5 req-31bb8cb4-75a2-44b1-baed-8228eb5f4b45 service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] No waiting events found dispatching network-vif-unplugged-361e6e85-04c1-41b7-8010-39456b498d6f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-5dc2a682-5b79-4025-b39f-cd127b0e0af5 req-31bb8cb4-75a2-44b1-baed-8228eb5f4b45 service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Received event network-vif-unplugged-361e6e85-04c1-41b7-8010-39456b498d6f for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:20:22 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Instance destroyed successfully.
Nov 10 21:20:22 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lazy-loading 'resources' on Instance uuid 3a0c67ef-1414-47e0-8769-c9164baf8993 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1994048602',display_name='tempest-ServersNegativeTestJSON-server-1994048602',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1994048602',id=17,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:10:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cea5dc310634b9da5042ae70e713b1e',ramdisk_id='',reservation_id='r-pmygk2bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-957099376',owner_user_name='tempest-ServersNegativeTestJSON-957099376-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:10:17Z,user_data=None,user_id='353cbd5fff0d4550b72b85c5073ae81d',uuid=3a0c67ef-1414-47e0-8769-c9164baf8993,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "361e6e85-04c1-41b7-8010-39456b498d6f", "address": "fa:16:3e:bd:d2:ae", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e6e85-04", "ovs_interfaceid": "361e6e85-04c1-41b7-8010-39456b498d6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Converting VIF {"id": "361e6e85-04c1-41b7-8010-39456b498d6f", "address": "fa:16:3e:bd:d2:ae", "network": {"id": "28e1d97a-a55b-41d2-83d4-600aedcecb6d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-592986480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cea5dc310634b9da5042ae70e713b1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e6e85-04", "ovs_interfaceid": "361e6e85-04c1-41b7-8010-39456b498d6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=361e6e85-04c1-41b7-8010-39456b498d6f,network=Network(28e1d97a-a55b-41d2-83d4-600aedcecb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e6e85-04') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG os_vif [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=361e6e85-04c1-41b7-8010-39456b498d6f,network=Network(28e1d97a-a55b-41d2-83d4-600aedcecb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e6e85-04') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap361e6e85-04, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d065f43-9c2f-4aaf-a986-1401850d2fec) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:20:22 user nova-compute[75285]: INFO os_vif [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=361e6e85-04c1-41b7-8010-39456b498d6f,network=Network(28e1d97a-a55b-41d2-83d4-600aedcecb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e6e85-04')
Nov 10 21:20:22 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Deleting instance files /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993_del
Nov 10 21:20:22 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Deletion of /opt/stack/data/nova/instances/3a0c67ef-1414-47e0-8769-c9164baf8993_del complete
Nov 10 21:20:22 user nova-compute[75285]: INFO nova.compute.manager [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 10 21:20:22 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:20:22 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:20:23 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:20:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-cbacf14f-acfe-4f7f-a186-6b4a4479ea77 req-a8a585c4-609c-43bd-9455-b02fe40f912b service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Received event network-vif-deleted-361e6e85-04c1-41b7-8010-39456b498d6f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:23 user nova-compute[75285]: INFO nova.compute.manager [req-cbacf14f-acfe-4f7f-a186-6b4a4479ea77 req-a8a585c4-609c-43bd-9455-b02fe40f912b service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Neutron deleted interface 361e6e85-04c1-41b7-8010-39456b498d6f; detaching it from the instance and deleting it from the info cache
Nov 10 21:20:23 user nova-compute[75285]: DEBUG nova.network.neutron [req-cbacf14f-acfe-4f7f-a186-6b4a4479ea77 req-a8a585c4-609c-43bd-9455-b02fe40f912b service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:20:23 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Took 0.53 seconds to deallocate network for instance.
Nov 10 21:20:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-cbacf14f-acfe-4f7f-a186-6b4a4479ea77 req-a8a585c4-609c-43bd-9455-b02fe40f912b service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Detach interface failed, port_id=361e6e85-04c1-41b7-8010-39456b498d6f, reason: Instance 3a0c67ef-1414-47e0-8769-c9164baf8993 could not be found. {{(pid=75285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 21:20:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:23 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:20:23 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:20:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:23 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Deleted allocations for instance 3a0c67ef-1414-47e0-8769-c9164baf8993
Nov 10 21:20:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f978bd1-0e84-4a7d-b439-cc2d4277ddc3 tempest-ServersNegativeTestJSON-957099376 tempest-ServersNegativeTestJSON-957099376-project-member] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.946s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-4db49ef2-eeda-4e48-81a2-49b367d9c624 req-a8fac05a-63ac-4e74-aff0-489310befb97 service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Received event network-vif-plugged-361e6e85-04c1-41b7-8010-39456b498d6f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4db49ef2-eeda-4e48-81a2-49b367d9c624 req-a8fac05a-63ac-4e74-aff0-489310befb97 service nova] Acquiring lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4db49ef2-eeda-4e48-81a2-49b367d9c624 req-a8fac05a-63ac-4e74-aff0-489310befb97 service nova] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4db49ef2-eeda-4e48-81a2-49b367d9c624 req-a8fac05a-63ac-4e74-aff0-489310befb97 service nova] Lock "3a0c67ef-1414-47e0-8769-c9164baf8993-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-4db49ef2-eeda-4e48-81a2-49b367d9c624 req-a8fac05a-63ac-4e74-aff0-489310befb97 service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] No waiting events found dispatching network-vif-plugged-361e6e85-04c1-41b7-8010-39456b498d6f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:20:24 user nova-compute[75285]: WARNING nova.compute.manager [req-4db49ef2-eeda-4e48-81a2-49b367d9c624 req-a8fac05a-63ac-4e74-aff0-489310befb97 service nova] [instance: 3a0c67ef-1414-47e0-8769-c9164baf8993] Received unexpected event network-vif-plugged-361e6e85-04c1-41b7-8010-39456b498d6f for instance with vm_state deleted and task_state None.
Nov 10 21:20:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:33 user nova-compute[75285]: INFO nova.compute.manager [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Terminating instance
Nov 10 21:20:33 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:20:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-5a25adc5-25b8-44da-a2a7-105def4c540d req-083ca84f-7213-4ffb-b093-035e1ed79a76 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-vif-unplugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5a25adc5-25b8-44da-a2a7-105def4c540d req-083ca84f-7213-4ffb-b093-035e1ed79a76 service nova] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5a25adc5-25b8-44da-a2a7-105def4c540d req-083ca84f-7213-4ffb-b093-035e1ed79a76 service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5a25adc5-25b8-44da-a2a7-105def4c540d req-083ca84f-7213-4ffb-b093-035e1ed79a76 service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-5a25adc5-25b8-44da-a2a7-105def4c540d req-083ca84f-7213-4ffb-b093-035e1ed79a76 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] No waiting events found dispatching network-vif-unplugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-5a25adc5-25b8-44da-a2a7-105def4c540d req-083ca84f-7213-4ffb-b093-035e1ed79a76 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-vif-unplugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:34 user nova-compute[75285]: INFO nova.compute.manager [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Detaching volume 3c46bfcc-e019-48fb-93ee-2657be00a702
Nov 10 21:20:34 user nova-compute[75285]: INFO nova.virt.block_device [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Attempting to driver detach volume 3c46bfcc-e019-48fb-93ee-2657be00a702 from mountpoint /dev/vdb
Nov 10 21:20:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Attempting to detach device vdb from instance 55399569-7ba7-4e75-9ded-1e9d6a7832d3 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:20:34 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:20:34 user nova-compute[75285]:   <source dev="/dev/sdf"/>
Nov 10 21:20:34 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:20:34 user nova-compute[75285]:   <serial>3c46bfcc-e019-48fb-93ee-2657be00a702</serial>
Nov 10 21:20:34 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:20:34 user nova-compute[75285]: </disk>
Nov 10 21:20:34 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:20:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Successfully detached device vdb from instance 55399569-7ba7-4e75-9ded-1e9d6a7832d3 from the persistent domain config.
Nov 10 21:20:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55399569-7ba7-4e75-9ded-1e9d6a7832d3 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:20:34 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:20:34 user nova-compute[75285]:   <source dev="/dev/sdf"/>
Nov 10 21:20:34 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:20:34 user nova-compute[75285]:   <serial>3c46bfcc-e019-48fb-93ee-2657be00a702</serial>
Nov 10 21:20:34 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:20:34 user nova-compute[75285]: </disk>
Nov 10 21:20:34 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:20:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Instance destroyed successfully.
Nov 10 21:20:34 user nova-compute[75285]: DEBUG nova.objects.instance [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lazy-loading 'resources' on Instance uuid 16f56b6b-f08d-4650-b0eb-a202662b0eb6 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1516474923',display_name='tempest-ServerRescueNegativeTestJSON-server-1516474923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1516474923',id=1,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:07:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44979c0f5b7d4205a0e5e0becbe714cb',ramdisk_id='',reservation_id='r-myu73inz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-418662944',owner_user_name='tempest-ServerRescueNegativeTestJSON-418662944-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:09:34Z,user_data=None,user_id='b9c20460877a428e9fa97869ba34eb04',uuid=16f56b6b-f08d-4650-b0eb-a202662b0eb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converting VIF {"id": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "address": "fa:16:3e:e9:4b:33", "network": {"id": "88d0150f-29ec-4fc9-9a3c-8c423612eb95", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-967829615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44979c0f5b7d4205a0e5e0becbe714cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a01ec6d-d0", "ovs_interfaceid": "9a01ec6d-d090-40da-bdbf-5bb60b90157e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=9a01ec6d-d090-40da-bdbf-5bb60b90157e,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a01ec6d-d0') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG os_vif [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=9a01ec6d-d090-40da-bdbf-5bb60b90157e,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a01ec6d-d0') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a01ec6d-d0, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22a3d415-347b-426e-b6c3-58e6bf7d1e0d) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:34 user nova-compute[75285]: INFO os_vif [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=9a01ec6d-d090-40da-bdbf-5bb60b90157e,network=Network(88d0150f-29ec-4fc9-9a3c-8c423612eb95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a01ec6d-d0')
Nov 10 21:20:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Deleting instance files /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6_del
Nov 10 21:20:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Deletion of /opt/stack/data/nova/instances/16f56b6b-f08d-4650-b0eb-a202662b0eb6_del complete
Nov 10 21:20:34 user nova-compute[75285]: INFO nova.compute.manager [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 10 21:20:34 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:20:34 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:20:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55399569-7ba7-4e75-9ded-1e9d6a7832d3 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:20:35 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:20:35 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Took 0.45 seconds to deallocate network for instance.
Nov 10 21:20:35 user nova-compute[75285]: DEBUG nova.compute.manager [req-b5d86312-f8b2-4ed5-b831-b4bd76953376 req-88869987-7689-4371-8d19-2489eb0034a0 service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-vif-deleted-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:35 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:20:35 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:20:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:35 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Deleted allocations for instance 16f56b6b-f08d-4650-b0eb-a202662b0eb6
Nov 10 21:20:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f08e1f05-d827-4d60-8ae0-657b4ba1bca3 tempest-ServerRescueNegativeTestJSON-418662944 tempest-ServerRescueNegativeTestJSON-418662944-project-member] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.978s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-4a87bb57-3968-4f87-b0ed-42f4318ebc6f req-5e0e95cc-ae50-4056-9bcf-fed3321abc2a service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4a87bb57-3968-4f87-b0ed-42f4318ebc6f req-5e0e95cc-ae50-4056-9bcf-fed3321abc2a service nova] Acquiring lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4a87bb57-3968-4f87-b0ed-42f4318ebc6f req-5e0e95cc-ae50-4056-9bcf-fed3321abc2a service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4a87bb57-3968-4f87-b0ed-42f4318ebc6f req-5e0e95cc-ae50-4056-9bcf-fed3321abc2a service nova] Lock "16f56b6b-f08d-4650-b0eb-a202662b0eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-4a87bb57-3968-4f87-b0ed-42f4318ebc6f req-5e0e95cc-ae50-4056-9bcf-fed3321abc2a service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] No waiting events found dispatching network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:20:36 user nova-compute[75285]: WARNING nova.compute.manager [req-4a87bb57-3968-4f87-b0ed-42f4318ebc6f req-5e0e95cc-ae50-4056-9bcf-fed3321abc2a service nova] [instance: 16f56b6b-f08d-4650-b0eb-a202662b0eb6] Received unexpected event network-vif-plugged-9a01ec6d-d090-40da-bdbf-5bb60b90157e for instance with vm_state deleted and task_state None.
Nov 10 21:20:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:20:42 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Creating image(s)
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "/opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "/opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "/opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.182s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk 1073741824" returned: 0 in 0.047s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Cannot resize image /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Ensure instance console log exists: /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Start _get_guest_xml network_info=[{"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '18f08415-3be3-4de6-88c5-fbd654f823bc', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIXdgROa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aeb029de-eec7-4b68-904a-6bca29f2cfad', 'attached_at': '', 'detached_at': '', 'volume_id': '43c87b96-d1cb-4ee8-8509-ae86d53b3cbd', 'serial': '43c87b96-d1cb-4ee8-8509-ae86d53b3cbd'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:20:42 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 21:20:42 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:20:42 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lazy-loading 'vcpu_model' on Instance uuid aeb029de-eec7-4b68-904a-6bca29f2cfad {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIXdgROa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:20:43 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:20:43 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:20:43 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03e15b7-6bb3-4e2d-8dd5-a50f7b6af6a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:20:43 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23a7ee9-7c6c-4359-bce8-6daa267c03ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd] added
Nov 10 21:20:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3ed028-c9a8-4c8a-bf10-825a47e130d6]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e25c27-df96-451e-9991-5896887591b9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YIXdgROa {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YIXdgROa" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c81c77-f551-4585-b7c9-081bacbc3994]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YIXdgROa'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[764abe86-68f3-4569-95db-29d4b8603c59]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e169862e-35cc-4665-af40-61f2b95d9050]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:43 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:43 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:20:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:43 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:43 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:20:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[102bb25f-9845-4738-ad8d-f0964fce6d06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260]
Nov 10 21:20:43 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260] successful.
Nov 10 21:20:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[91793468-e102-4171-ad4a-69b6386f94ef]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[99013dac-cefd-4f29-bd40-240a0bf33823]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:43 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:43 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:20:43 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:20:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:43 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:43 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:20:43 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:20:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7154bf-9bb5-4984-8ada-8e3e1478d735]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIXdgROa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26463626663613038', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463626663613038', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T21:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1344900563',display_name='tempest-ServerActionsTestOtherA-server-27154683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1344900563',id=29,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCxz8/kJz7qMuJbbL+KhjPzwEhpgkXsTZPfLxJMquouIKyOErI7tWXMR4fRwx1eDtPTfwTq81cvUjsQcmjJRTEGBLbNgsXVL83Z8Zpp2H9OVcF/7u80FuAIt3FNaKBzxw==',key_name='tempest-keypair-2088221850',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-xjx70px8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=aeb029de-eec7-4b68-904a-6bca29f2cfad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=a484cc1a-32f1-4e1c-95fd-7f80c428e9f0,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa484cc1a-32') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:20:44 user nova-compute[75285]:   <uuid>aeb029de-eec7-4b68-904a-6bca29f2cfad</uuid>
Nov 10 21:20:44 user nova-compute[75285]:   <name>instance-0000001d</name>
Nov 10 21:20:44 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:20:44 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:20:44 user nova-compute[75285]:   <metadata>
Nov 10 21:20:44 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:20:44 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:20:44 user nova-compute[75285]:       <nova:name>tempest-ServerActionsTestOtherA-server-27154683</nova:name>
Nov 10 21:20:44 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:20:42</nova:creationTime>
Nov 10 21:20:44 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:20:44 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:20:44 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:20:44 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:20:44 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:20:44 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:20:44 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:20:44 user nova-compute[75285]:       <nova:owner>
Nov 10 21:20:44 user nova-compute[75285]:         <nova:user uuid="187d346b3e1b453e8404662727b21a7f">tempest-ServerActionsTestOtherA-1895961867-project-member</nova:user>
Nov 10 21:20:44 user nova-compute[75285]:         <nova:project uuid="e582cea01cf0449fad27fafe0f2d0b4e">tempest-ServerActionsTestOtherA-1895961867</nova:project>
Nov 10 21:20:44 user nova-compute[75285]:       </nova:owner>
Nov 10 21:20:44 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:20:44 user nova-compute[75285]:       <nova:ports>
Nov 10 21:20:44 user nova-compute[75285]:         <nova:port uuid="a484cc1a-32f1-4e1c-95fd-7f80c428e9f0">
Nov 10 21:20:44 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 21:20:44 user nova-compute[75285]:         </nova:port>
Nov 10 21:20:44 user nova-compute[75285]:       </nova:ports>
Nov 10 21:20:44 user nova-compute[75285]:     </nova:instance>
Nov 10 21:20:44 user nova-compute[75285]:   </metadata>
Nov 10 21:20:44 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:20:44 user nova-compute[75285]:     <system>
Nov 10 21:20:44 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:20:44 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:20:44 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:20:44 user nova-compute[75285]:       <entry name="serial">aeb029de-eec7-4b68-904a-6bca29f2cfad</entry>
Nov 10 21:20:44 user nova-compute[75285]:       <entry name="uuid">aeb029de-eec7-4b68-904a-6bca29f2cfad</entry>
Nov 10 21:20:44 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:20:44 user nova-compute[75285]:     </system>
Nov 10 21:20:44 user nova-compute[75285]:   </sysinfo>
Nov 10 21:20:44 user nova-compute[75285]:   <os>
Nov 10 21:20:44 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:20:44 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:20:44 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:20:44 user nova-compute[75285]:   </os>
Nov 10 21:20:44 user nova-compute[75285]:   <features>
Nov 10 21:20:44 user nova-compute[75285]:     <acpi/>
Nov 10 21:20:44 user nova-compute[75285]:     <apic/>
Nov 10 21:20:44 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:20:44 user nova-compute[75285]:   </features>
Nov 10 21:20:44 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:20:44 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:20:44 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:20:44 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:20:44 user nova-compute[75285]:   </clock>
Nov 10 21:20:44 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:20:44 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:20:44 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:20:44 user nova-compute[75285]:   </cpu>
Nov 10 21:20:44 user nova-compute[75285]:   <devices>
Nov 10 21:20:44 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:20:44 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:20:44 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk"/>
Nov 10 21:20:44 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:20:44 user nova-compute[75285]:     </disk>
Nov 10 21:20:44 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:20:44 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:20:44 user nova-compute[75285]:       <source dev="/dev/sdb"/>
Nov 10 21:20:44 user nova-compute[75285]:       <target dev="vdb" bus="virtio"/>
Nov 10 21:20:44 user nova-compute[75285]:       <serial>43c87b96-d1cb-4ee8-8509-ae86d53b3cbd</serial>
Nov 10 21:20:44 user nova-compute[75285]:     </disk>
Nov 10 21:20:44 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:20:44 user nova-compute[75285]:       <mac address="fa:16:3e:b2:f9:97"/>
Nov 10 21:20:44 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:20:44 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:20:44 user nova-compute[75285]:       <target dev="tapa484cc1a-32"/>
Nov 10 21:20:44 user nova-compute[75285]:     </interface>
Nov 10 21:20:44 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:20:44 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/console.log" append="off"/>
Nov 10 21:20:44 user nova-compute[75285]:     </serial>
Nov 10 21:20:44 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:20:44 user nova-compute[75285]:     <video>
Nov 10 21:20:44 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:20:44 user nova-compute[75285]:     </video>
Nov 10 21:20:44 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:20:44 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:20:44 user nova-compute[75285]:     </rng>
Nov 10 21:20:44 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:20:44 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:20:44 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:20:44 user nova-compute[75285]:     </memballoon>
Nov 10 21:20:44 user nova-compute[75285]:   </devices>
Nov 10 21:20:44 user nova-compute[75285]: </domain>
Nov 10 21:20:44 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T21:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1344900563',display_name='tempest-ServerActionsTestOtherA-server-27154683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1344900563',id=29,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCxz8/kJz7qMuJbbL+KhjPzwEhpgkXsTZPfLxJMquouIKyOErI7tWXMR4fRwx1eDtPTfwTq81cvUjsQcmjJRTEGBLbNgsXVL83Z8Zpp2H9OVcF/7u80FuAIt3FNaKBzxw==',key_name='tempest-keypair-2088221850',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-xjx70px8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=aeb029de-eec7-4b68-904a-6bca29f2cfad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=a484cc1a-32f1-4e1c-95fd-7f80c428e9f0,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa484cc1a-32') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG os_vif [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=a484cc1a-32f1-4e1c-95fd-7f80c428e9f0,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa484cc1a-32') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db829078-f659-5202-b634-8fed0054a17e', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa484cc1a-32, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa484cc1a-32, col_values=(('qos', UUID('fef6114e-548b-4c61-b545-80ef61397f43')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa484cc1a-32, col_values=(('external_ids', {'iface-id': 'a484cc1a-32f1-4e1c-95fd-7f80c428e9f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:f9:97', 'vm-uuid': 'aeb029de-eec7-4b68-904a-6bca29f2cfad'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:44 user nova-compute[75285]: INFO os_vif [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=a484cc1a-32f1-4e1c-95fd-7f80c428e9f0,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa484cc1a-32')
Nov 10 21:20:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:20:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] No VIF found with MAC fa:16:3e:b2:f9:97, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:20:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-5c3fb123-a0d7-4826-9ff3-ba8ffa5e9377 req-f1a3d214-35a7-4673-a156-98070308fd48 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received event network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5c3fb123-a0d7-4826-9ff3-ba8ffa5e9377 req-f1a3d214-35a7-4673-a156-98070308fd48 service nova] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5c3fb123-a0d7-4826-9ff3-ba8ffa5e9377 req-f1a3d214-35a7-4673-a156-98070308fd48 service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5c3fb123-a0d7-4826-9ff3-ba8ffa5e9377 req-f1a3d214-35a7-4673-a156-98070308fd48 service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-5c3fb123-a0d7-4826-9ff3-ba8ffa5e9377 req-f1a3d214-35a7-4673-a156-98070308fd48 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] No waiting events found dispatching network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:20:46 user nova-compute[75285]: WARNING nova.compute.manager [req-5c3fb123-a0d7-4826-9ff3-ba8ffa5e9377 req-f1a3d214-35a7-4673-a156-98070308fd48 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received unexpected event network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 21:20:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:47 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:20:47 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:20:47 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:20:47 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:20:47 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Skipping network cache update for instance because it is being deleted. {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 10 21:20:47 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Skipping network cache update for instance because it is Building. {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 21:20:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:20:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:20:47 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:20:47 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid 32d2946b-f299-4b62-9f3b-6c00b0b8858b {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:20:48 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Instance spawned successfully.
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.compute.manager [req-0d6bd504-08fe-4c8d-a222-cc0940261459 req-c8f97d8f-1145-43b1-a6d5-f21d03af5d8a service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received event network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0d6bd504-08fe-4c8d-a222-cc0940261459 req-c8f97d8f-1145-43b1-a6d5-f21d03af5d8a service nova] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0d6bd504-08fe-4c8d-a222-cc0940261459 req-c8f97d8f-1145-43b1-a6d5-f21d03af5d8a service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0d6bd504-08fe-4c8d-a222-cc0940261459 req-c8f97d8f-1145-43b1-a6d5-f21d03af5d8a service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.compute.manager [req-0d6bd504-08fe-4c8d-a222-cc0940261459 req-c8f97d8f-1145-43b1-a6d5-f21d03af5d8a service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] No waiting events found dispatching network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:20:48 user nova-compute[75285]: WARNING nova.compute.manager [req-0d6bd504-08fe-4c8d-a222-cc0940261459 req-c8f97d8f-1145-43b1-a6d5-f21d03af5d8a service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received unexpected event network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Updating instance_info_cache with network_info: [{"id": "e351ba01-6d16-40ea-ae88-097b9756cc70", "address": "fa:16:3e:a6:48:80", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape351ba01-6d", "ovs_interfaceid": "e351ba01-6d16-40ea-ae88-097b9756cc70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75285) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 10 21:20:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c60af25a-c131-4215-9216-f220cdc86fcc tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.080s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:49 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:20:50 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:20:50 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:20:51 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:20:51 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:20:52 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:20:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:52 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:20:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:20:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:20:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:20:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:20:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:55 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 55399569-7ba7-4e75-9ded-1e9d6a7832d3 is timed out.
Nov 10 21:20:55 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Successfully detached device vdb from instance 55399569-7ba7-4e75-9ded-1e9d6a7832d3 from the live domain config.
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leDotkNZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:20:55 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2551190b-6e76-4fa6-93ba-803af53804d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:20:55 user nova-compute[75285]: No targets found.
Nov 10 21:20:55 user nova-compute[75285]: iSNS:
Nov 10 21:20:55 user nova-compute[75285]: No targets found.
Nov 10 21:20:55 user nova-compute[75285]: STATIC:
Nov 10 21:20:55 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:20:55 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:20:55 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:20:55 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c
Nov 10 21:20:55 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:20:55 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:20:55 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd
Nov 10 21:20:55 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:20:55 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:20:55 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702
Nov 10 21:20:55 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:20:55 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:20:55 user nova-compute[75285]: FIRMWARE:
Nov 10 21:20:55 user nova-compute[75285]: No targets found.
Nov 10 21:20:55 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:20:55 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:20:55 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f698a1-57a7-4a70-a84b-e112560c3013]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9e5e9d-bf37-49e2-898e-7e97ac662cf7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:55 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:55 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:20:55 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:20:55 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:55 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:55 user nova-compute[75285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 (non-flash)
Nov 10 21:20:55 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:20:55 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e45ab910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702'): ({'sdf'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Removing single pathed devices sdf {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbb3cb4-5d5a-4df1-8b29-d5308cf95783]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afc065f-a63c-45a9-a1b2-c2ff1a529856]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Flushing IO for device /dev/sdf {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d48ac3-ff8f-47af-8422-19da053e25f6]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[912c5207-5354-47f4-8312-87ea30b105d9]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] SCSI volumes sdf have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd875640-6b4f-4ed1-acd5-70dbff886a76]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98aab76-e412-4b25-96fe-e67f4ab8f4a1]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702, portal: 172.16.0.220,3260]
Nov 10 21:20:55 user nova-compute[75285]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702, portal: 172.16.0.220,3260] successful.
Nov 10 21:20:55 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:55 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:20:55 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7907MB free_disk=25.05113983154297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23b942e-cb76-49db-9821-66141f0d0022]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.697s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] <== disconnect_volume: return (699ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 55399569-7ba7-4e75-9ded-1e9d6a7832d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ef5f5450-aef1-48f8-b2c0-617d4fb1803d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance aeb029de-eec7-4b68-904a-6bca29f2cfad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c7933247-e939-4ede-a431-e91488332000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 2fec5869-3e7f-4c56-907b-0e00727be6b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 61cc694d-55cf-4492-bd5f-b65c733da4ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 63869b5c-443c-4bc6-ac63-f3b559290917 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:20:55 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:20:56 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:20:56 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:20:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:20:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:56 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lazy-loading 'flavor' on Instance uuid 55399569-7ba7-4e75-9ded-1e9d6a7832d3 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:20:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c8516d05-fbb8-4319-bdc4-f78ea1da599e tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.316s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.123s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:56 user nova-compute[75285]: INFO nova.compute.manager [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Terminating instance
Nov 10 21:20:56 user nova-compute[75285]: DEBUG nova.compute.manager [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:20:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-ff447196-2f97-486b-bd20-b4746b4ad2a6 req-2eef1d0f-2a0a-414f-8cfa-d0627aa2b47b service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Received event network-vif-unplugged-5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ff447196-2f97-486b-bd20-b4746b4ad2a6 req-2eef1d0f-2a0a-414f-8cfa-d0627aa2b47b service nova] Acquiring lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ff447196-2f97-486b-bd20-b4746b4ad2a6 req-2eef1d0f-2a0a-414f-8cfa-d0627aa2b47b service nova] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ff447196-2f97-486b-bd20-b4746b4ad2a6 req-2eef1d0f-2a0a-414f-8cfa-d0627aa2b47b service nova] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-ff447196-2f97-486b-bd20-b4746b4ad2a6 req-2eef1d0f-2a0a-414f-8cfa-d0627aa2b47b service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] No waiting events found dispatching network-vif-unplugged-5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-ff447196-2f97-486b-bd20-b4746b4ad2a6 req-2eef1d0f-2a0a-414f-8cfa-d0627aa2b47b service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Received event network-vif-unplugged-5a6b57ea-fb79-4587-a514-43ffa86697b2 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:20:57 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Instance destroyed successfully.
Nov 10 21:20:57 user nova-compute[75285]: DEBUG nova.objects.instance [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lazy-loading 'resources' on Instance uuid 55399569-7ba7-4e75-9ded-1e9d6a7832d3 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1276661455',display_name='tempest-VolumesSnapshotTestJSON-instance-1276661455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1276661455',id=27,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZC1cFvaF2TRHwvd9aoZtEONnqdw0HARFQyQxicwSOsEZsbCoKb2Wq3HRphD9id0QW2eGqr2vUO8cc2JnXrokyErX1XxoPAuzNi685jWO3RNuCUtmhwypZrFeHAk2Pyfw==',key_name='tempest-keypair-2134104118',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:15:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b61b6bd18de14243b858764031ccd52b',ramdisk_id='',reservation_id='r-996165r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1530341723',owner_user_name='tempest-VolumesSnapshotTestJSON-1530341723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15813044958a4b52866c3273903d12db',uuid=55399569-7ba7-4e75-9ded-1e9d6a7832d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "address": "fa:16:3e:bf:71:70", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6b57ea-fb", "ovs_interfaceid": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Converting VIF {"id": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "address": "fa:16:3e:bf:71:70", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6b57ea-fb", "ovs_interfaceid": "5a6b57ea-fb79-4587-a514-43ffa86697b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:71:70,bridge_name='br-int',has_traffic_filtering=True,id=5a6b57ea-fb79-4587-a514-43ffa86697b2,network=Network(310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6b57ea-fb') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG os_vif [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:71:70,bridge_name='br-int',has_traffic_filtering=True,id=5a6b57ea-fb79-4587-a514-43ffa86697b2,network=Network(310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6b57ea-fb') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a6b57ea-fb, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7d99310-8377-4e0d-85e0-326c20e05a6d) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:20:57 user nova-compute[75285]: INFO os_vif [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:71:70,bridge_name='br-int',has_traffic_filtering=True,id=5a6b57ea-fb79-4587-a514-43ffa86697b2,network=Network(310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6b57ea-fb')
Nov 10 21:20:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leDotkNZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:20:57 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:20:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b689d96-0381-4ea9-96f8-5a27b8b037cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:20:57 user nova-compute[75285]: No targets found.
Nov 10 21:20:57 user nova-compute[75285]: iSNS:
Nov 10 21:20:57 user nova-compute[75285]: No targets found.
Nov 10 21:20:57 user nova-compute[75285]: STATIC:
Nov 10 21:20:57 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:20:57 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:20:57 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:20:57 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c
Nov 10 21:20:57 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:20:57 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:20:57 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd
Nov 10 21:20:57 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:20:57 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:20:57 user nova-compute[75285]: FIRMWARE:
Nov 10 21:20:57 user nova-compute[75285]: No targets found.
Nov 10 21:20:57 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:20:57 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:20:57 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c46bfcc-e019-48fb-93ee-2657be00a702', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c84e09-76f1-4da9-9beb-56e81300e35e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ad4c2a-708f-4b50-b9b4-55cf41dd1a51]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:57 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:57 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:20:57 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:20:57 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:20:57 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:20:57 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a0427f130>, {}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Disconnecting from: [] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] <== disconnect_volume: return (70ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:20:57 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Deleting instance files /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3_del
Nov 10 21:20:57 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Deletion of /opt/stack/data/nova/instances/55399569-7ba7-4e75-9ded-1e9d6a7832d3_del complete
Nov 10 21:20:57 user nova-compute[75285]: INFO nova.compute.manager [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 10 21:20:57 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:20:57 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:20:58 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:20:58 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Took 0.67 seconds to deallocate network for instance.
Nov 10 21:20:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-b9bc5e77-c8d4-4d05-b694-506829d2f7a2 req-ec88f32b-a8cd-4cb8-a4bf-45d6bb503265 service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Received event network-vif-deleted-5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:58 user nova-compute[75285]: WARNING nova.volume.cinder [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Attachment 9dbe7f5c-9f4a-458b-a377-3384bb45bf97 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9dbe7f5c-9f4a-458b-a377-3384bb45bf97. (HTTP 404) (Request-ID: req-0d10869a-60c6-45e7-8331-4fde807a1c0d)
Nov 10 21:20:58 user nova-compute[75285]: INFO nova.compute.manager [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Took 0.03 seconds to detach 1 volumes for instance.
Nov 10 21:20:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:58 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:20:58 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:20:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:58 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Deleted allocations for instance 55399569-7ba7-4e75-9ded-1e9d6a7832d3
Nov 10 21:20:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-855ce3fe-cd1b-4f2e-b49b-39e13d0887d2 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.137s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-f917550b-5a17-45f3-b673-a05372be5704 req-9b2ef700-a5a9-401f-9852-f191029c2258 service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Received event network-vif-plugged-5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:20:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f917550b-5a17-45f3-b673-a05372be5704 req-9b2ef700-a5a9-401f-9852-f191029c2258 service nova] Acquiring lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:20:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f917550b-5a17-45f3-b673-a05372be5704 req-9b2ef700-a5a9-401f-9852-f191029c2258 service nova] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:20:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f917550b-5a17-45f3-b673-a05372be5704 req-9b2ef700-a5a9-401f-9852-f191029c2258 service nova] Lock "55399569-7ba7-4e75-9ded-1e9d6a7832d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:20:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-f917550b-5a17-45f3-b673-a05372be5704 req-9b2ef700-a5a9-401f-9852-f191029c2258 service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] No waiting events found dispatching network-vif-plugged-5a6b57ea-fb79-4587-a514-43ffa86697b2 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:20:59 user nova-compute[75285]: WARNING nova.compute.manager [req-f917550b-5a17-45f3-b673-a05372be5704 req-9b2ef700-a5a9-401f-9852-f191029c2258 service nova] [instance: 55399569-7ba7-4e75-9ded-1e9d6a7832d3] Received unexpected event network-vif-plugged-5a6b57ea-fb79-4587-a514-43ffa86697b2 for instance with vm_state deleted and task_state None.
Nov 10 21:20:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:20:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:20:59 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:21:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "2fec5869-3e7f-4c56-907b-0e00727be6b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "2fec5869-3e7f-4c56-907b-0e00727be6b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:01 user nova-compute[75285]: INFO nova.compute.manager [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Terminating instance
Nov 10 21:21:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:21:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG nova.compute.manager [req-096aaebb-27ef-4a82-8b52-06ec5f74b11b req-aa7da655-7ece-45d4-8df7-12a94dcb44e7 service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Received event network-vif-unplugged-8d058958-d4c3-467e-8749-9fed94afe30e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-096aaebb-27ef-4a82-8b52-06ec5f74b11b req-aa7da655-7ece-45d4-8df7-12a94dcb44e7 service nova] Acquiring lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-096aaebb-27ef-4a82-8b52-06ec5f74b11b req-aa7da655-7ece-45d4-8df7-12a94dcb44e7 service nova] Lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-096aaebb-27ef-4a82-8b52-06ec5f74b11b req-aa7da655-7ece-45d4-8df7-12a94dcb44e7 service nova] Lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG nova.compute.manager [req-096aaebb-27ef-4a82-8b52-06ec5f74b11b req-aa7da655-7ece-45d4-8df7-12a94dcb44e7 service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] No waiting events found dispatching network-vif-unplugged-8d058958-d4c3-467e-8749-9fed94afe30e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG nova.compute.manager [req-096aaebb-27ef-4a82-8b52-06ec5f74b11b req-aa7da655-7ece-45d4-8df7-12a94dcb44e7 service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Received event network-vif-unplugged-8d058958-d4c3-467e-8749-9fed94afe30e for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:21:02 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Instance destroyed successfully.
Nov 10 21:21:02 user nova-compute[75285]: DEBUG nova.objects.instance [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lazy-loading 'resources' on Instance uuid 2fec5869-3e7f-4c56-907b-0e00727be6b2 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-556851745',display_name='tempest-VolumesActionsTest-instance-556851745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-556851745',id=31,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:19:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbd29a6eea20479c817a2d10d68d474c',ramdisk_id='',reservation_id='r-jrsb5fbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-115087691',owner_user_name='tempest-VolumesActionsTest-115087691-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:19:18Z,user_data=None,user_id='cd355e7ffc524aceb404b0dc3da858ed',uuid=2fec5869-3e7f-4c56-907b-0e00727be6b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d058958-d4c3-467e-8749-9fed94afe30e", "address": "fa:16:3e:cf:c2:11", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d058958-d4", "ovs_interfaceid": "8d058958-d4c3-467e-8749-9fed94afe30e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Converting VIF {"id": "8d058958-d4c3-467e-8749-9fed94afe30e", "address": "fa:16:3e:cf:c2:11", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d058958-d4", "ovs_interfaceid": "8d058958-d4c3-467e-8749-9fed94afe30e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c2:11,bridge_name='br-int',has_traffic_filtering=True,id=8d058958-d4c3-467e-8749-9fed94afe30e,network=Network(bf1a11ae-8cfd-4986-985c-b8b237922d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d058958-d4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG os_vif [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c2:11,bridge_name='br-int',has_traffic_filtering=True,id=8d058958-d4c3-467e-8749-9fed94afe30e,network=Network(bf1a11ae-8cfd-4986-985c-b8b237922d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d058958-d4') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d058958-d4, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07997787-b3c8-4b71-b7ed-2c769b938758) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:02 user nova-compute[75285]: INFO os_vif [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c2:11,bridge_name='br-int',has_traffic_filtering=True,id=8d058958-d4c3-467e-8749-9fed94afe30e,network=Network(bf1a11ae-8cfd-4986-985c-b8b237922d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d058958-d4')
Nov 10 21:21:02 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Deleting instance files /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2_del
Nov 10 21:21:02 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Deletion of /opt/stack/data/nova/instances/2fec5869-3e7f-4c56-907b-0e00727be6b2_del complete
Nov 10 21:21:02 user nova-compute[75285]: INFO nova.compute.manager [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 10 21:21:02 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:21:02 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:21:03 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:21:03 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Took 0.46 seconds to deallocate network for instance.
Nov 10 21:21:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-5e353957-bcb3-414e-8933-6d8e86b7ece7 req-8a1d7066-b8ad-4fea-937d-6318c52b878b service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Received event network-vif-deleted-8d058958-d4c3-467e-8749-9fed94afe30e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:21:03 user nova-compute[75285]: INFO nova.compute.manager [req-5e353957-bcb3-414e-8933-6d8e86b7ece7 req-8a1d7066-b8ad-4fea-937d-6318c52b878b service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Neutron deleted interface 8d058958-d4c3-467e-8749-9fed94afe30e; detaching it from the instance and deleting it from the info cache
Nov 10 21:21:03 user nova-compute[75285]: DEBUG nova.network.neutron [req-5e353957-bcb3-414e-8933-6d8e86b7ece7 req-8a1d7066-b8ad-4fea-937d-6318c52b878b service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:21:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-5e353957-bcb3-414e-8933-6d8e86b7ece7 req-8a1d7066-b8ad-4fea-937d-6318c52b878b service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Detach interface failed, port_id=8d058958-d4c3-467e-8749-9fed94afe30e, reason: Instance 2fec5869-3e7f-4c56-907b-0e00727be6b2 could not be found. {{(pid=75285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 21:21:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:03 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:21:03 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:21:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:03 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Deleted allocations for instance 2fec5869-3e7f-4c56-907b-0e00727be6b2
Nov 10 21:21:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1b17df65-77d2-4829-9d4e-958115681249 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "2fec5869-3e7f-4c56-907b-0e00727be6b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.758s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:04 user nova-compute[75285]: DEBUG nova.compute.manager [req-fb57003b-9363-401c-bc29-33e068d027cd req-bc0ad72f-4acd-4907-9c41-c1fea9c935ae service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Received event network-vif-plugged-8d058958-d4c3-467e-8749-9fed94afe30e {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:21:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fb57003b-9363-401c-bc29-33e068d027cd req-bc0ad72f-4acd-4907-9c41-c1fea9c935ae service nova] Acquiring lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fb57003b-9363-401c-bc29-33e068d027cd req-bc0ad72f-4acd-4907-9c41-c1fea9c935ae service nova] Lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fb57003b-9363-401c-bc29-33e068d027cd req-bc0ad72f-4acd-4907-9c41-c1fea9c935ae service nova] Lock "2fec5869-3e7f-4c56-907b-0e00727be6b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:04 user nova-compute[75285]: DEBUG nova.compute.manager [req-fb57003b-9363-401c-bc29-33e068d027cd req-bc0ad72f-4acd-4907-9c41-c1fea9c935ae service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] No waiting events found dispatching network-vif-plugged-8d058958-d4c3-467e-8749-9fed94afe30e {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:21:04 user nova-compute[75285]: WARNING nova.compute.manager [req-fb57003b-9363-401c-bc29-33e068d027cd req-bc0ad72f-4acd-4907-9c41-c1fea9c935ae service nova] [instance: 2fec5869-3e7f-4c56-907b-0e00727be6b2] Received unexpected event network-vif-plugged-8d058958-d4c3-467e-8749-9fed94afe30e for instance with vm_state deleted and task_state None.
Nov 10 21:21:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "f7280d37-4576-488e-ab31-45dddecf2f93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:21:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:15 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:21:15 user nova-compute[75285]: INFO nova.compute.claims [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Claim successful on node user
Nov 10 21:21:15 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:21:15 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:21:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:21:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:21:15 user nova-compute[75285]: DEBUG nova.network.neutron [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:21:15 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:21:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:21:15 user nova-compute[75285]: DEBUG nova.policy [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac13c724170f47368e5a395110c631b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9957f55c59044088e94338564e04092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:21:15 user nova-compute[75285]: INFO nova.virt.block_device [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Booting with volume-backed-image e00023c7-f7f3-49f2-b464-c809b7ab7608 at /dev/vda
Nov 10 21:21:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:16 user nova-compute[75285]: DEBUG nova.network.neutron [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Successfully created port: a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:21:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:17 user nova-compute[75285]: DEBUG nova.network.neutron [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Successfully updated port: a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:21:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "refresh_cache-f7280d37-4576-488e-ab31-45dddecf2f93" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:21:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquired lock "refresh_cache-f7280d37-4576-488e-ab31-45dddecf2f93" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:21:17 user nova-compute[75285]: DEBUG nova.network.neutron [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:21:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-9154698c-bcc0-434e-9cf6-be1b6b017d25 req-dc1d41df-206c-44a2-8023-77cf6c383e0d service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-changed-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:21:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-9154698c-bcc0-434e-9cf6-be1b6b017d25 req-dc1d41df-206c-44a2-8023-77cf6c383e0d service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Refreshing instance network info cache due to event network-changed-a7af338b-7f5a-4847-9746-a770f1182b11. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:21:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9154698c-bcc0-434e-9cf6-be1b6b017d25 req-dc1d41df-206c-44a2-8023-77cf6c383e0d service nova] Acquiring lock "refresh_cache-f7280d37-4576-488e-ab31-45dddecf2f93" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:21:17 user nova-compute[75285]: DEBUG nova.network.neutron [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:21:18 user nova-compute[75285]: DEBUG nova.network.neutron [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Updating instance_info_cache with network_info: [{"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:21:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Releasing lock "refresh_cache-f7280d37-4576-488e-ab31-45dddecf2f93" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:21:18 user nova-compute[75285]: DEBUG nova.compute.manager [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Instance network_info: |[{"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:21:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9154698c-bcc0-434e-9cf6-be1b6b017d25 req-dc1d41df-206c-44a2-8023-77cf6c383e0d service nova] Acquired lock "refresh_cache-f7280d37-4576-488e-ab31-45dddecf2f93" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:21:18 user nova-compute[75285]: DEBUG nova.network.neutron [req-9154698c-bcc0-434e-9cf6-be1b6b017d25 req-dc1d41df-206c-44a2-8023-77cf6c383e0d service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Refreshing network info cache for port a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:21:19 user nova-compute[75285]: DEBUG nova.network.neutron [req-9154698c-bcc0-434e-9cf6-be1b6b017d25 req-dc1d41df-206c-44a2-8023-77cf6c383e0d service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Updated VIF entry in instance network info cache for port a7af338b-7f5a-4847-9746-a770f1182b11. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:21:19 user nova-compute[75285]: DEBUG nova.network.neutron [req-9154698c-bcc0-434e-9cf6-be1b6b017d25 req-dc1d41df-206c-44a2-8023-77cf6c383e0d service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Updating instance_info_cache with network_info: [{"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:21:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9154698c-bcc0-434e-9cf6-be1b6b017d25 req-dc1d41df-206c-44a2-8023-77cf6c383e0d service nova] Releasing lock "refresh_cache-f7280d37-4576-488e-ab31-45dddecf2f93" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.compute.manager [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:21:21 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Creating image(s)
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Did not create local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Ensure instance console log exists: /opt/stack/data/nova/instances/61cc694d-55cf-4492-bd5f-b65c733da4ba/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Start _get_guest_xml network_info=[{"id": "4956aff6-094a-4b0d-92f5-d270b683c547", "address": "fa:16:3e:3e:ee:00", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4956aff6-09", "ovs_interfaceid": "4956aff6-094a-4b0d-92f5-d270b683c547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '6cb29837-49a7-4282-9585-2d700037449b', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BagbvNEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '61cc694d-55cf-4492-bd5f-b65c733da4ba', 'attached_at': '', 'detached_at': '', 'volume_id': '38e67fe5-c80f-4955-864b-23d9bd58f845', 'serial': '38e67fe5-c80f-4955-864b-23d9bd58f845'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:21:21 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:21:21 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BagbvNEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:21:21 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:21:21 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:21:21 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff853a69-87f2-46c1-84f0-2e5230679e73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:21:21 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8251f021-c91f-4137-94cc-7e87b36ec68a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845] added
Nov 10 21:21:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d423794-be97-4298-92af-54b1a850785f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5963bf-e0d0-4dd5-af60-85cc9e39a5bc]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BagbvNEI {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BagbvNEI" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62b20f8-e41f-461f-923c-9c4677d46b88]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BagbvNEI'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4dd438-0bb9-4425-9c00-9ba13fb2637e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06063ab-6bae-4502-9bba-ef06ac6eb50d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:21:21 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:21:21 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:21:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:21:21 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:21:21 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:21:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bef4cb3-0953-405e-8574-4f6f8efe18cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845, portal: 172.16.0.220,3260]
Nov 10 21:21:21 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845, portal: 172.16.0.220,3260] successful.
Nov 10 21:21:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea8a6bf-8e97-4608-8de9-49e1842e079e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d054c9d0-57b1-403a-b610-6cfed3bb08f4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:21:21 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:21:21 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:21:21 user nova-compute[75285]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 (non-flash)
Nov 10 21:21:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:21:21 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:21:21 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:21:21 user nova-compute[75285]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 (non-flash)
Nov 10 21:21:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[877660b1-a57d-4fc1-ae2f-47c377a2cb51]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:21:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BagbvNEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26563633635623363', 'path': '/dev/sdd'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563633635623363', 'path': '/dev/sdd'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-34115249',display_name='tempest-TestVolumeBootPattern-server-34115249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-34115249',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAAoUPxLI+zueb7o2tu1JS76f604TN+uq+pfg2zYS5MbkMZtx1Ub2kBFu6OB71sTNt8tpmOHljKAgKzRpBKVdyr/VTj1zgWyamAFtpMuzpYAL+WhfMApRgNi/CTwdcWlw==',key_name='tempest-TestVolumeBootPattern-2083573923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04636b8a9e404d40a3a2bc9f63a4df8c',ramdisk_id='',reservation_id='r-kehhth01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1962512242',owner_user_name='tempest-TestVolumeBootPattern-1962512242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:20:00Z,user_data=None,user_id='e16c471c0875416aa0eb86d89eef3a27',uuid=61cc694d-55cf-4492-bd5f-b65c733da4ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4956aff6-094a-4b0d-92f5-d270b683c547", "address": "fa:16:3e:3e:ee:00", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4956aff6-09", "ovs_interfaceid": "4956aff6-094a-4b0d-92f5-d270b683c547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converting VIF {"id": "4956aff6-094a-4b0d-92f5-d270b683c547", "address": "fa:16:3e:3e:ee:00", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4956aff6-09", "ovs_interfaceid": "4956aff6-094a-4b0d-92f5-d270b683c547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ee:00,bridge_name='br-int',has_traffic_filtering=True,id=4956aff6-094a-4b0d-92f5-d270b683c547,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4956aff6-09') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG nova.objects.instance [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lazy-loading 'pci_devices' on Instance uuid 61cc694d-55cf-4492-bd5f-b65c733da4ba {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:21:22 user nova-compute[75285]:   <uuid>61cc694d-55cf-4492-bd5f-b65c733da4ba</uuid>
Nov 10 21:21:22 user nova-compute[75285]:   <name>instance-00000020</name>
Nov 10 21:21:22 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:21:22 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:21:22 user nova-compute[75285]:   <metadata>
Nov 10 21:21:22 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:21:22 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:21:22 user nova-compute[75285]:       <nova:name>tempest-TestVolumeBootPattern-server-34115249</nova:name>
Nov 10 21:21:22 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:21:21</nova:creationTime>
Nov 10 21:21:22 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:21:22 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:21:22 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:21:22 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:21:22 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:21:22 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:21:22 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:21:22 user nova-compute[75285]:       <nova:owner>
Nov 10 21:21:22 user nova-compute[75285]:         <nova:user uuid="e16c471c0875416aa0eb86d89eef3a27">tempest-TestVolumeBootPattern-1962512242-project-member</nova:user>
Nov 10 21:21:22 user nova-compute[75285]:         <nova:project uuid="04636b8a9e404d40a3a2bc9f63a4df8c">tempest-TestVolumeBootPattern-1962512242</nova:project>
Nov 10 21:21:22 user nova-compute[75285]:       </nova:owner>
Nov 10 21:21:22 user nova-compute[75285]:       <nova:ports>
Nov 10 21:21:22 user nova-compute[75285]:         <nova:port uuid="4956aff6-094a-4b0d-92f5-d270b683c547">
Nov 10 21:21:22 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 21:21:22 user nova-compute[75285]:         </nova:port>
Nov 10 21:21:22 user nova-compute[75285]:       </nova:ports>
Nov 10 21:21:22 user nova-compute[75285]:     </nova:instance>
Nov 10 21:21:22 user nova-compute[75285]:   </metadata>
Nov 10 21:21:22 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:21:22 user nova-compute[75285]:     <system>
Nov 10 21:21:22 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:21:22 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:21:22 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:21:22 user nova-compute[75285]:       <entry name="serial">61cc694d-55cf-4492-bd5f-b65c733da4ba</entry>
Nov 10 21:21:22 user nova-compute[75285]:       <entry name="uuid">61cc694d-55cf-4492-bd5f-b65c733da4ba</entry>
Nov 10 21:21:22 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:21:22 user nova-compute[75285]:     </system>
Nov 10 21:21:22 user nova-compute[75285]:   </sysinfo>
Nov 10 21:21:22 user nova-compute[75285]:   <os>
Nov 10 21:21:22 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:21:22 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:21:22 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:21:22 user nova-compute[75285]:   </os>
Nov 10 21:21:22 user nova-compute[75285]:   <features>
Nov 10 21:21:22 user nova-compute[75285]:     <acpi/>
Nov 10 21:21:22 user nova-compute[75285]:     <apic/>
Nov 10 21:21:22 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:21:22 user nova-compute[75285]:   </features>
Nov 10 21:21:22 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:21:22 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:21:22 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:21:22 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:21:22 user nova-compute[75285]:   </clock>
Nov 10 21:21:22 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:21:22 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:21:22 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:21:22 user nova-compute[75285]:   </cpu>
Nov 10 21:21:22 user nova-compute[75285]:   <devices>
Nov 10 21:21:22 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:21:22 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:21:22 user nova-compute[75285]:       <source dev="/dev/sdd"/>
Nov 10 21:21:22 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:21:22 user nova-compute[75285]:       <serial>38e67fe5-c80f-4955-864b-23d9bd58f845</serial>
Nov 10 21:21:22 user nova-compute[75285]:     </disk>
Nov 10 21:21:22 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:21:22 user nova-compute[75285]:       <mac address="fa:16:3e:3e:ee:00"/>
Nov 10 21:21:22 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:21:22 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:21:22 user nova-compute[75285]:       <target dev="tap4956aff6-09"/>
Nov 10 21:21:22 user nova-compute[75285]:     </interface>
Nov 10 21:21:22 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:21:22 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/61cc694d-55cf-4492-bd5f-b65c733da4ba/console.log" append="off"/>
Nov 10 21:21:22 user nova-compute[75285]:     </serial>
Nov 10 21:21:22 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:21:22 user nova-compute[75285]:     <video>
Nov 10 21:21:22 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:21:22 user nova-compute[75285]:     </video>
Nov 10 21:21:22 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:21:22 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:21:22 user nova-compute[75285]:     </rng>
Nov 10 21:21:22 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:21:22 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:21:22 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:21:22 user nova-compute[75285]:     </memballoon>
Nov 10 21:21:22 user nova-compute[75285]:   </devices>
Nov 10 21:21:22 user nova-compute[75285]: </domain>
Nov 10 21:21:22 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-34115249',display_name='tempest-TestVolumeBootPattern-server-34115249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-34115249',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAAoUPxLI+zueb7o2tu1JS76f604TN+uq+pfg2zYS5MbkMZtx1Ub2kBFu6OB71sTNt8tpmOHljKAgKzRpBKVdyr/VTj1zgWyamAFtpMuzpYAL+WhfMApRgNi/CTwdcWlw==',key_name='tempest-TestVolumeBootPattern-2083573923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04636b8a9e404d40a3a2bc9f63a4df8c',ramdisk_id='',reservation_id='r-kehhth01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1962512242',owner_user_name='tempest-TestVolumeBootPattern-1962512242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:20:00Z,user_data=None,user_id='e16c471c0875416aa0eb86d89eef3a27',uuid=61cc694d-55cf-4492-bd5f-b65c733da4ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4956aff6-094a-4b0d-92f5-d270b683c547", "address": "fa:16:3e:3e:ee:00", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4956aff6-09", "ovs_interfaceid": "4956aff6-094a-4b0d-92f5-d270b683c547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converting VIF {"id": "4956aff6-094a-4b0d-92f5-d270b683c547", "address": "fa:16:3e:3e:ee:00", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4956aff6-09", "ovs_interfaceid": "4956aff6-094a-4b0d-92f5-d270b683c547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ee:00,bridge_name='br-int',has_traffic_filtering=True,id=4956aff6-094a-4b0d-92f5-d270b683c547,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4956aff6-09') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG os_vif [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ee:00,bridge_name='br-int',has_traffic_filtering=True,id=4956aff6-094a-4b0d-92f5-d270b683c547,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4956aff6-09') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd201d56-78a7-5ce3-94c0-b2884665539c', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4956aff6-09, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4956aff6-09, col_values=(('qos', UUID('43fb45e2-b7f6-4962-a56e-a3fef4e759d9')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4956aff6-09, col_values=(('external_ids', {'iface-id': '4956aff6-094a-4b0d-92f5-d270b683c547', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:ee:00', 'vm-uuid': '61cc694d-55cf-4492-bd5f-b65c733da4ba'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:22 user nova-compute[75285]: INFO os_vif [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ee:00,bridge_name='br-int',has_traffic_filtering=True,id=4956aff6-094a-4b0d-92f5-d270b683c547,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4956aff6-09')
Nov 10 21:21:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:21:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] No VIF found with MAC fa:16:3e:3e:ee:00, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:21:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-89c56715-e68c-4c2f-a414-58518530e3e8 req-8ab8ea5a-8a91-472c-9083-41c91fdb4684 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Received event network-vif-plugged-4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:21:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-89c56715-e68c-4c2f-a414-58518530e3e8 req-8ab8ea5a-8a91-472c-9083-41c91fdb4684 service nova] Acquiring lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-89c56715-e68c-4c2f-a414-58518530e3e8 req-8ab8ea5a-8a91-472c-9083-41c91fdb4684 service nova] Lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-89c56715-e68c-4c2f-a414-58518530e3e8 req-8ab8ea5a-8a91-472c-9083-41c91fdb4684 service nova] Lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-89c56715-e68c-4c2f-a414-58518530e3e8 req-8ab8ea5a-8a91-472c-9083-41c91fdb4684 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] No waiting events found dispatching network-vif-plugged-4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:21:24 user nova-compute[75285]: WARNING nova.compute.manager [req-89c56715-e68c-4c2f-a414-58518530e3e8 req-8ab8ea5a-8a91-472c-9083-41c91fdb4684 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Received unexpected event network-vif-plugged-4956aff6-094a-4b0d-92f5-d270b683c547 for instance with vm_state building and task_state spawning.
Nov 10 21:21:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:26 user nova-compute[75285]: DEBUG nova.compute.manager [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:21:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:21:26 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Instance spawned successfully.
Nov 10 21:21:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:21:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:21:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:21:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:21:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:21:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:21:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:21:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-2642684c-921a-4002-a099-37ba104346e8 req-ba0692d9-ef2d-47c3-95f2-1f26e4a47e8e service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Received event network-vif-plugged-4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:21:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2642684c-921a-4002-a099-37ba104346e8 req-ba0692d9-ef2d-47c3-95f2-1f26e4a47e8e service nova] Acquiring lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2642684c-921a-4002-a099-37ba104346e8 req-ba0692d9-ef2d-47c3-95f2-1f26e4a47e8e service nova] Lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2642684c-921a-4002-a099-37ba104346e8 req-ba0692d9-ef2d-47c3-95f2-1f26e4a47e8e service nova] Lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-2642684c-921a-4002-a099-37ba104346e8 req-ba0692d9-ef2d-47c3-95f2-1f26e4a47e8e service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] No waiting events found dispatching network-vif-plugged-4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:21:26 user nova-compute[75285]: WARNING nova.compute.manager [req-2642684c-921a-4002-a099-37ba104346e8 req-ba0692d9-ef2d-47c3-95f2-1f26e4a47e8e service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Received unexpected event network-vif-plugged-4956aff6-094a-4b0d-92f5-d270b683c547 for instance with vm_state building and task_state spawning.
Nov 10 21:21:26 user nova-compute[75285]: INFO nova.compute.manager [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 10 21:21:26 user nova-compute[75285]: DEBUG nova.compute.manager [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:21:26 user nova-compute[75285]: INFO nova.compute.manager [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Took 86.93 seconds to build instance.
Nov 10 21:21:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-008453c2-a733-4df4-8290-9b7c8e44f73d tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "61cc694d-55cf-4492-bd5f-b65c733da4ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 87.035s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:36 user nova-compute[75285]: DEBUG os_brick.utils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:21:36 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce56da7b-aadc-4858-bf0e-57287e2ecd7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f97dacc-4f6f-47fd-bf1e-2f3202deaa08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8ec763-3115-407c-bca9-6fcb0fe34056]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d87cbb-f3d7-4f48-94e5-2fe3d29ae36b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:21:37 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:21:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cd6958-fa89-4601-a03d-226fae21bcb3]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG os_brick.utils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Updating existing volume attachment record: 6fef6cf8-efe0-4e1d-a305-1ca05c6c8ed5 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:21:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:47 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:21:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:49 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:21:49 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:21:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:21:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:21:49 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:21:50 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Updating instance_info_cache with network_info: [{"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:21:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:21:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:21:50 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:21:51 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:21:51 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:21:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:21:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:21:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:21:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "7abac387-cc1d-4f17-9698-ea7db05489b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:53 user nova-compute[75285]: DEBUG nova.compute.manager [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:21:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:53 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:21:53 user nova-compute[75285]: INFO nova.compute.claims [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Claim successful on node user
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.613s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG nova.compute.manager [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG nova.compute.manager [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG nova.network.neutron [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:21:54 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:21:54 user nova-compute[75285]: DEBUG nova.compute.manager [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG nova.policy [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd355e7ffc524aceb404b0dc3da858ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd29a6eea20479c817a2d10d68d474c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG nova.compute.manager [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:21:54 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Creating image(s)
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "/opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "/opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "/opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/disk 1073741824" returned: 0 in 0.081s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG nova.network.neutron [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Successfully created port: 8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.216s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Cannot resize image /opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Ensure instance console log exists: /opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Successfully updated port: 8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-a87589e5-55fb-4a54-87e5-f780a6dd9c45 req-b9b07c2e-c577-43c6-85e5-c8d93a0e187c service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received event network-changed-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-a87589e5-55fb-4a54-87e5-f780a6dd9c45 req-b9b07c2e-c577-43c6-85e5-c8d93a0e187c service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Refreshing instance network info cache due to event network-changed-8ea3941e-eac0-4125-a5a0-0bbc50e3b832. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a87589e5-55fb-4a54-87e5-f780a6dd9c45 req-b9b07c2e-c577-43c6-85e5-c8d93a0e187c service nova] Acquiring lock "refresh_cache-7abac387-cc1d-4f17-9698-ea7db05489b2" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a87589e5-55fb-4a54-87e5-f780a6dd9c45 req-b9b07c2e-c577-43c6-85e5-c8d93a0e187c service nova] Acquired lock "refresh_cache-7abac387-cc1d-4f17-9698-ea7db05489b2" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.network.neutron [req-a87589e5-55fb-4a54-87e5-f780a6dd9c45 req-b9b07c2e-c577-43c6-85e5-c8d93a0e187c service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Refreshing network info cache for port 8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "refresh_cache-7abac387-cc1d-4f17-9698-ea7db05489b2" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:21:56 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:21:56 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7956MB free_disk=25.065906524658203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.network.neutron [req-a87589e5-55fb-4a54-87e5-f780a6dd9c45 req-b9b07c2e-c577-43c6-85e5-c8d93a0e187c service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ef5f5450-aef1-48f8-b2c0-617d4fb1803d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance aeb029de-eec7-4b68-904a-6bca29f2cfad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c7933247-e939-4ede-a431-e91488332000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 61cc694d-55cf-4492-bd5f-b65c733da4ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 63869b5c-443c-4bc6-ac63-f3b559290917 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance f7280d37-4576-488e-ab31-45dddecf2f93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 7abac387-cc1d-4f17-9698-ea7db05489b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.network.neutron [req-a87589e5-55fb-4a54-87e5-f780a6dd9c45 req-b9b07c2e-c577-43c6-85e5-c8d93a0e187c service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a87589e5-55fb-4a54-87e5-f780a6dd9c45 req-b9b07c2e-c577-43c6-85e5-c8d93a0e187c service nova] Releasing lock "refresh_cache-7abac387-cc1d-4f17-9698-ea7db05489b2" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquired lock "refresh_cache-7abac387-cc1d-4f17-9698-ea7db05489b2" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:21:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.network.neutron [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Updating instance_info_cache with network_info: [{"id": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "address": "fa:16:3e:db:33:cb", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3941e-ea", "ovs_interfaceid": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Releasing lock "refresh_cache-7abac387-cc1d-4f17-9698-ea7db05489b2" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Instance network_info: |[{"id": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "address": "fa:16:3e:db:33:cb", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3941e-ea", "ovs_interfaceid": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Start _get_guest_xml network_info=[{"id": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "address": "fa:16:3e:db:33:cb", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3941e-ea", "ovs_interfaceid": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:21:57 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:21:57 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1879305195',display_name='tempest-VolumesActionsTest-instance-1879305195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1879305195',id=35,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbd29a6eea20479c817a2d10d68d474c',ramdisk_id='',reservation_id='r-8cn2d2lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-115087691',owner_user_name='tempest-VolumesActionsTest-115087691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:21:55Z,user_data=None,user_id='cd355e7ffc524aceb404b0dc3da858ed',uuid=7abac387-cc1d-4f17-9698-ea7db05489b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "address": "fa:16:3e:db:33:cb", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3941e-ea", "ovs_interfaceid": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Converting VIF {"id": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "address": "fa:16:3e:db:33:cb", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3941e-ea", "ovs_interfaceid": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:33:cb,bridge_name='br-int',has_traffic_filtering=True,id=8ea3941e-eac0-4125-a5a0-0bbc50e3b832,network=Network(bf1a11ae-8cfd-4986-985c-b8b237922d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3941e-ea') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.objects.instance [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lazy-loading 'pci_devices' on Instance uuid 7abac387-cc1d-4f17-9698-ea7db05489b2 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:21:57 user nova-compute[75285]:   <uuid>7abac387-cc1d-4f17-9698-ea7db05489b2</uuid>
Nov 10 21:21:57 user nova-compute[75285]:   <name>instance-00000023</name>
Nov 10 21:21:57 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:21:57 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:21:57 user nova-compute[75285]:   <metadata>
Nov 10 21:21:57 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:21:57 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:21:57 user nova-compute[75285]:       <nova:name>tempest-VolumesActionsTest-instance-1879305195</nova:name>
Nov 10 21:21:57 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:21:57</nova:creationTime>
Nov 10 21:21:57 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:21:57 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:21:57 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:21:57 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:21:57 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:21:57 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:21:57 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:21:57 user nova-compute[75285]:       <nova:owner>
Nov 10 21:21:57 user nova-compute[75285]:         <nova:user uuid="cd355e7ffc524aceb404b0dc3da858ed">tempest-VolumesActionsTest-115087691-project-member</nova:user>
Nov 10 21:21:57 user nova-compute[75285]:         <nova:project uuid="fbd29a6eea20479c817a2d10d68d474c">tempest-VolumesActionsTest-115087691</nova:project>
Nov 10 21:21:57 user nova-compute[75285]:       </nova:owner>
Nov 10 21:21:57 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:21:57 user nova-compute[75285]:       <nova:ports>
Nov 10 21:21:57 user nova-compute[75285]:         <nova:port uuid="8ea3941e-eac0-4125-a5a0-0bbc50e3b832">
Nov 10 21:21:57 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 21:21:57 user nova-compute[75285]:         </nova:port>
Nov 10 21:21:57 user nova-compute[75285]:       </nova:ports>
Nov 10 21:21:57 user nova-compute[75285]:     </nova:instance>
Nov 10 21:21:57 user nova-compute[75285]:   </metadata>
Nov 10 21:21:57 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:21:57 user nova-compute[75285]:     <system>
Nov 10 21:21:57 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:21:57 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:21:57 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:21:57 user nova-compute[75285]:       <entry name="serial">7abac387-cc1d-4f17-9698-ea7db05489b2</entry>
Nov 10 21:21:57 user nova-compute[75285]:       <entry name="uuid">7abac387-cc1d-4f17-9698-ea7db05489b2</entry>
Nov 10 21:21:57 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:21:57 user nova-compute[75285]:     </system>
Nov 10 21:21:57 user nova-compute[75285]:   </sysinfo>
Nov 10 21:21:57 user nova-compute[75285]:   <os>
Nov 10 21:21:57 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:21:57 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:21:57 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:21:57 user nova-compute[75285]:   </os>
Nov 10 21:21:57 user nova-compute[75285]:   <features>
Nov 10 21:21:57 user nova-compute[75285]:     <acpi/>
Nov 10 21:21:57 user nova-compute[75285]:     <apic/>
Nov 10 21:21:57 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:21:57 user nova-compute[75285]:   </features>
Nov 10 21:21:57 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:21:57 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:21:57 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:21:57 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:21:57 user nova-compute[75285]:   </clock>
Nov 10 21:21:57 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:21:57 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:21:57 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:21:57 user nova-compute[75285]:   </cpu>
Nov 10 21:21:57 user nova-compute[75285]:   <devices>
Nov 10 21:21:57 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:21:57 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:21:57 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/disk"/>
Nov 10 21:21:57 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:21:57 user nova-compute[75285]:     </disk>
Nov 10 21:21:57 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:21:57 user nova-compute[75285]:       <mac address="fa:16:3e:db:33:cb"/>
Nov 10 21:21:57 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:21:57 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:21:57 user nova-compute[75285]:       <target dev="tap8ea3941e-ea"/>
Nov 10 21:21:57 user nova-compute[75285]:     </interface>
Nov 10 21:21:57 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:21:57 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/console.log" append="off"/>
Nov 10 21:21:57 user nova-compute[75285]:     </serial>
Nov 10 21:21:57 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:21:57 user nova-compute[75285]:     <video>
Nov 10 21:21:57 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:21:57 user nova-compute[75285]:     </video>
Nov 10 21:21:57 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:21:57 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:21:57 user nova-compute[75285]:     </rng>
Nov 10 21:21:57 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:21:57 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:21:57 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:21:57 user nova-compute[75285]:     </memballoon>
Nov 10 21:21:57 user nova-compute[75285]:   </devices>
Nov 10 21:21:57 user nova-compute[75285]: </domain>
Nov 10 21:21:57 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1879305195',display_name='tempest-VolumesActionsTest-instance-1879305195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1879305195',id=35,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbd29a6eea20479c817a2d10d68d474c',ramdisk_id='',reservation_id='r-8cn2d2lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-115087691',owner_user_name='tempest-VolumesActionsTest-115087691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:21:55Z,user_data=None,user_id='cd355e7ffc524aceb404b0dc3da858ed',uuid=7abac387-cc1d-4f17-9698-ea7db05489b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "address": "fa:16:3e:db:33:cb", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3941e-ea", "ovs_interfaceid": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Converting VIF {"id": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "address": "fa:16:3e:db:33:cb", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3941e-ea", "ovs_interfaceid": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:33:cb,bridge_name='br-int',has_traffic_filtering=True,id=8ea3941e-eac0-4125-a5a0-0bbc50e3b832,network=Network(bf1a11ae-8cfd-4986-985c-b8b237922d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3941e-ea') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG os_vif [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:33:cb,bridge_name='br-int',has_traffic_filtering=True,id=8ea3941e-eac0-4125-a5a0-0bbc50e3b832,network=Network(bf1a11ae-8cfd-4986-985c-b8b237922d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3941e-ea') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0814cef-6c2f-53ae-b5b1-c56122bf15af', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ea3941e-ea, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ea3941e-ea, col_values=(('qos', UUID('07961e6d-18e5-410e-8a57-ef102a63a003')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ea3941e-ea, col_values=(('external_ids', {'iface-id': '8ea3941e-eac0-4125-a5a0-0bbc50e3b832', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:33:cb', 'vm-uuid': '7abac387-cc1d-4f17-9698-ea7db05489b2'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:57 user nova-compute[75285]: INFO os_vif [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:33:cb,bridge_name='br-int',has_traffic_filtering=True,id=8ea3941e-eac0-4125-a5a0-0bbc50e3b832,network=Network(bf1a11ae-8cfd-4986-985c-b8b237922d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3941e-ea')
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:21:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] No VIF found with MAC fa:16:3e:db:33:cb, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:21:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-e5ff3d46-21d5-45d8-b718-307c83ceb1e4 req-0a27e57d-5d06-4258-b0ad-bb2b91df2b75 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received event network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:21:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e5ff3d46-21d5-45d8-b718-307c83ceb1e4 req-0a27e57d-5d06-4258-b0ad-bb2b91df2b75 service nova] Acquiring lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:21:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e5ff3d46-21d5-45d8-b718-307c83ceb1e4 req-0a27e57d-5d06-4258-b0ad-bb2b91df2b75 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:21:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e5ff3d46-21d5-45d8-b718-307c83ceb1e4 req-0a27e57d-5d06-4258-b0ad-bb2b91df2b75 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:21:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-e5ff3d46-21d5-45d8-b718-307c83ceb1e4 req-0a27e57d-5d06-4258-b0ad-bb2b91df2b75 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] No waiting events found dispatching network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:21:59 user nova-compute[75285]: WARNING nova.compute.manager [req-e5ff3d46-21d5-45d8-b718-307c83ceb1e4 req-0a27e57d-5d06-4258-b0ad-bb2b91df2b75 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received unexpected event network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 for instance with vm_state building and task_state spawning.
Nov 10 21:21:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-714def73-cb5c-4657-b8cc-239cb6b3c122 req-96f3c075-bb60-411e-aa63-c74479c69ed8 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received event network-changed-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:21:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-714def73-cb5c-4657-b8cc-239cb6b3c122 req-96f3c075-bb60-411e-aa63-c74479c69ed8 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Refreshing instance network info cache due to event network-changed-a027d49a-f9ca-43fa-af0c-e62afd4e83dc. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:21:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-714def73-cb5c-4657-b8cc-239cb6b3c122 req-96f3c075-bb60-411e-aa63-c74479c69ed8 service nova] Acquiring lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:21:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-714def73-cb5c-4657-b8cc-239cb6b3c122 req-96f3c075-bb60-411e-aa63-c74479c69ed8 service nova] Acquired lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:21:59 user nova-compute[75285]: DEBUG nova.network.neutron [req-714def73-cb5c-4657-b8cc-239cb6b3c122 req-96f3c075-bb60-411e-aa63-c74479c69ed8 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Refreshing network info cache for port a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:21:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:21:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:00 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:22:00 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:22:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:22:00 user nova-compute[75285]: DEBUG nova.network.neutron [req-714def73-cb5c-4657-b8cc-239cb6b3c122 req-96f3c075-bb60-411e-aa63-c74479c69ed8 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updated VIF entry in instance network info cache for port a027d49a-f9ca-43fa-af0c-e62afd4e83dc. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:22:00 user nova-compute[75285]: DEBUG nova.network.neutron [req-714def73-cb5c-4657-b8cc-239cb6b3c122 req-96f3c075-bb60-411e-aa63-c74479c69ed8 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updating instance_info_cache with network_info: [{"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:22:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-714def73-cb5c-4657-b8cc-239cb6b3c122 req-96f3c075-bb60-411e-aa63-c74479c69ed8 service nova] Releasing lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:22:01 user nova-compute[75285]: DEBUG nova.compute.manager [req-63637831-c3dc-433f-ae40-b95006286bbd req-8eb903b6-721b-443b-bdf3-839c85c82686 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received event network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:22:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-63637831-c3dc-433f-ae40-b95006286bbd req-8eb903b6-721b-443b-bdf3-839c85c82686 service nova] Acquiring lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-63637831-c3dc-433f-ae40-b95006286bbd req-8eb903b6-721b-443b-bdf3-839c85c82686 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-63637831-c3dc-433f-ae40-b95006286bbd req-8eb903b6-721b-443b-bdf3-839c85c82686 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:01 user nova-compute[75285]: DEBUG nova.compute.manager [req-63637831-c3dc-433f-ae40-b95006286bbd req-8eb903b6-721b-443b-bdf3-839c85c82686 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] No waiting events found dispatching network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:22:01 user nova-compute[75285]: WARNING nova.compute.manager [req-63637831-c3dc-433f-ae40-b95006286bbd req-8eb903b6-721b-443b-bdf3-839c85c82686 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received unexpected event network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 for instance with vm_state building and task_state spawning.
Nov 10 21:22:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:22:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:22:01 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Instance spawned successfully.
Nov 10 21:22:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:22:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:01 user nova-compute[75285]: INFO nova.compute.manager [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Took 6.69 seconds to spawn the instance on the hypervisor.
Nov 10 21:22:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:22:01 user nova-compute[75285]: INFO nova.compute.manager [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Took 7.80 seconds to build instance.
Nov 10 21:22:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-51f3b007-abee-4e7e-8581-858dd474dcd2 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.955s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.compute.manager [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:22:11 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Creating image(s)
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Did not create local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Ensure instance console log exists: /opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Start _get_guest_xml network_info=[{"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '6fef6cf8-efe0-4e1d-a305-1ca05c6c8ed5', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqpSXRkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7280d37-4576-488e-ab31-45dddecf2f93', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9', 'serial': 'ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:22:11 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:22:11 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqpSXRkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:22:11 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:22:11 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:22:11 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88aeb13-0b79-47cf-bec8-7802f698959e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:22:11 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfbb0f3-82f6-4b10-b0d5-0f480d464c27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9] added
Nov 10 21:22:11 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7a8a2a-924e-43e2-bae9-2be9d699d664]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[51797462-cef3-4331-a5fd-956a2f357fa4]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqpSXRkB {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqpSXRkB" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b920cf6-4eb5-4671-b16d-4de3e41f1fee]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HqpSXRkB'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea1b53-a3ff-46c1-8a4a-411579d7ecb9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d20b64-ab6b-4f42-ac70-5076ed9229f4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:22:11 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:22:11 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:22:11 user nova-compute[75285]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 (non-flash)
Nov 10 21:22:11 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:22:11 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:22:11 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:22:11 user nova-compute[75285]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 (non-flash)
Nov 10 21:22:11 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dd2ede-78c1-4f70-90e3-26ab08bd062e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9, portal: 172.16.0.220,3260]
Nov 10 21:22:11 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9, portal: 172.16.0.220,3260] successful.
Nov 10 21:22:11 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[683fb1f8-fbd7-4a4b-962b-e231f67d4e43]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:22:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:12 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[881d9ef9-bd02-4438-843b-4818d76dc6ba]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:12 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:22:12 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:22:12 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:22:12 user nova-compute[75285]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 (non-flash)
Nov 10 21:22:12 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:22:12 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:22:12 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:22:12 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:22:12 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:22:12 user nova-compute[75285]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 (non-flash)
Nov 10 21:22:12 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:22:12 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:22:12 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:22:12 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:22:12 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:22:12 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:22:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:12 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9445404a-246c-439b-acd0-5d1283b1f542]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:12 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:22:12 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqpSXRkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:22:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '23336376261396662', 'path': '/dev/sdf'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336376261396662', 'path': '/dev/sdf'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1144674436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1144674436',id=34,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9957f55c59044088e94338564e04092',ramdisk_id='',reservation_id='r-kaz9xqte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-396261753',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:21:16Z,user_data=None,user_id='ac13c724170f47368e5a395110c631b7',uuid=f7280d37-4576-488e-ab31-45dddecf2f93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converting VIF {"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a0:f4,bridge_name='br-int',has_traffic_filtering=True,id=a7af338b-7f5a-4847-9746-a770f1182b11,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7af338b-7f') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG nova.objects.instance [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'pci_devices' on Instance uuid f7280d37-4576-488e-ab31-45dddecf2f93 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:22:13 user nova-compute[75285]:   <uuid>f7280d37-4576-488e-ab31-45dddecf2f93</uuid>
Nov 10 21:22:13 user nova-compute[75285]:   <name>instance-00000022</name>
Nov 10 21:22:13 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:22:13 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:22:13 user nova-compute[75285]:   <metadata>
Nov 10 21:22:13 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:22:13 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:22:13 user nova-compute[75285]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1144674436</nova:name>
Nov 10 21:22:13 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:22:11</nova:creationTime>
Nov 10 21:22:13 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:22:13 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:22:13 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:22:13 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:22:13 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:22:13 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:22:13 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:22:13 user nova-compute[75285]:       <nova:owner>
Nov 10 21:22:13 user nova-compute[75285]:         <nova:user uuid="ac13c724170f47368e5a395110c631b7">tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member</nova:user>
Nov 10 21:22:13 user nova-compute[75285]:         <nova:project uuid="b9957f55c59044088e94338564e04092">tempest-ServerBootFromVolumeStableRescueTest-396261753</nova:project>
Nov 10 21:22:13 user nova-compute[75285]:       </nova:owner>
Nov 10 21:22:13 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:22:13 user nova-compute[75285]:       <nova:ports>
Nov 10 21:22:13 user nova-compute[75285]:         <nova:port uuid="a7af338b-7f5a-4847-9746-a770f1182b11">
Nov 10 21:22:13 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 21:22:13 user nova-compute[75285]:         </nova:port>
Nov 10 21:22:13 user nova-compute[75285]:       </nova:ports>
Nov 10 21:22:13 user nova-compute[75285]:     </nova:instance>
Nov 10 21:22:13 user nova-compute[75285]:   </metadata>
Nov 10 21:22:13 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:22:13 user nova-compute[75285]:     <system>
Nov 10 21:22:13 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:22:13 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:22:13 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:22:13 user nova-compute[75285]:       <entry name="serial">f7280d37-4576-488e-ab31-45dddecf2f93</entry>
Nov 10 21:22:13 user nova-compute[75285]:       <entry name="uuid">f7280d37-4576-488e-ab31-45dddecf2f93</entry>
Nov 10 21:22:13 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:22:13 user nova-compute[75285]:     </system>
Nov 10 21:22:13 user nova-compute[75285]:   </sysinfo>
Nov 10 21:22:13 user nova-compute[75285]:   <os>
Nov 10 21:22:13 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:22:13 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:22:13 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:22:13 user nova-compute[75285]:   </os>
Nov 10 21:22:13 user nova-compute[75285]:   <features>
Nov 10 21:22:13 user nova-compute[75285]:     <acpi/>
Nov 10 21:22:13 user nova-compute[75285]:     <apic/>
Nov 10 21:22:13 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:22:13 user nova-compute[75285]:   </features>
Nov 10 21:22:13 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:22:13 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:22:13 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:22:13 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:22:13 user nova-compute[75285]:   </clock>
Nov 10 21:22:13 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:22:13 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:22:13 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:22:13 user nova-compute[75285]:   </cpu>
Nov 10 21:22:13 user nova-compute[75285]:   <devices>
Nov 10 21:22:13 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:22:13 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:22:13 user nova-compute[75285]:       <source dev="/dev/sdf"/>
Nov 10 21:22:13 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:22:13 user nova-compute[75285]:       <serial>ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9</serial>
Nov 10 21:22:13 user nova-compute[75285]:     </disk>
Nov 10 21:22:13 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:22:13 user nova-compute[75285]:       <mac address="fa:16:3e:f9:a0:f4"/>
Nov 10 21:22:13 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:22:13 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:22:13 user nova-compute[75285]:       <target dev="tapa7af338b-7f"/>
Nov 10 21:22:13 user nova-compute[75285]:     </interface>
Nov 10 21:22:13 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:22:13 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93/console.log" append="off"/>
Nov 10 21:22:13 user nova-compute[75285]:     </serial>
Nov 10 21:22:13 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:22:13 user nova-compute[75285]:     <video>
Nov 10 21:22:13 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:22:13 user nova-compute[75285]:     </video>
Nov 10 21:22:13 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:22:13 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:22:13 user nova-compute[75285]:     </rng>
Nov 10 21:22:13 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:22:13 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:22:13 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:22:13 user nova-compute[75285]:     </memballoon>
Nov 10 21:22:13 user nova-compute[75285]:   </devices>
Nov 10 21:22:13 user nova-compute[75285]: </domain>
Nov 10 21:22:13 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1144674436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1144674436',id=34,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9957f55c59044088e94338564e04092',ramdisk_id='',reservation_id='r-kaz9xqte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-396261753',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:21:16Z,user_data=None,user_id='ac13c724170f47368e5a395110c631b7',uuid=f7280d37-4576-488e-ab31-45dddecf2f93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converting VIF {"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a0:f4,bridge_name='br-int',has_traffic_filtering=True,id=a7af338b-7f5a-4847-9746-a770f1182b11,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7af338b-7f') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG os_vif [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a0:f4,bridge_name='br-int',has_traffic_filtering=True,id=a7af338b-7f5a-4847-9746-a770f1182b11,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7af338b-7f') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aef889f6-95af-5cda-84d1-8b9b3cc2b9e9', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7af338b-7f, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7af338b-7f, col_values=(('qos', UUID('920b2612-6d5e-444b-9dff-85b380dc3ad9')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7af338b-7f, col_values=(('external_ids', {'iface-id': 'a7af338b-7f5a-4847-9746-a770f1182b11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:a0:f4', 'vm-uuid': 'f7280d37-4576-488e-ab31-45dddecf2f93'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:13 user nova-compute[75285]: INFO os_vif [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a0:f4,bridge_name='br-int',has_traffic_filtering=True,id=a7af338b-7f5a-4847-9746-a770f1182b11,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7af338b-7f')
Nov 10 21:22:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] No VIF found with MAC fa:16:3e:f9:a0:f4, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "63869b5c-443c-4bc6-ac63-f3b559290917" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "63869b5c-443c-4bc6-ac63-f3b559290917" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:13 user nova-compute[75285]: INFO nova.compute.manager [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Shelving
Nov 10 21:22:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-1c8fdfcd-7283-435d-ad06-b559b0091700 req-52802f4c-e7ab-4a63-89a2-5a85720fca76 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received event network-vif-unplugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:22:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1c8fdfcd-7283-435d-ad06-b559b0091700 req-52802f4c-e7ab-4a63-89a2-5a85720fca76 service nova] Acquiring lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1c8fdfcd-7283-435d-ad06-b559b0091700 req-52802f4c-e7ab-4a63-89a2-5a85720fca76 service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1c8fdfcd-7283-435d-ad06-b559b0091700 req-52802f4c-e7ab-4a63-89a2-5a85720fca76 service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-1c8fdfcd-7283-435d-ad06-b559b0091700 req-52802f4c-e7ab-4a63-89a2-5a85720fca76 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] No waiting events found dispatching network-vif-unplugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:22:14 user nova-compute[75285]: WARNING nova.compute.manager [req-1c8fdfcd-7283-435d-ad06-b559b0091700 req-52802f4c-e7ab-4a63-89a2-5a85720fca76 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received unexpected event network-vif-unplugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc for instance with vm_state active and task_state shelving.
Nov 10 21:22:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:14 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Instance destroyed successfully.
Nov 10 21:22:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:15 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Beginning cold snapshot process
Nov 10 21:22:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-6982fac1-395b-498a-a1da-0482bfad3bb7 req-f96705fe-904b-436c-b60e-25172eb7206c service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:22:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6982fac1-395b-498a-a1da-0482bfad3bb7 req-f96705fe-904b-436c-b60e-25172eb7206c service nova] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6982fac1-395b-498a-a1da-0482bfad3bb7 req-f96705fe-904b-436c-b60e-25172eb7206c service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6982fac1-395b-498a-a1da-0482bfad3bb7 req-f96705fe-904b-436c-b60e-25172eb7206c service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-6982fac1-395b-498a-a1da-0482bfad3bb7 req-f96705fe-904b-436c-b60e-25172eb7206c service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] No waiting events found dispatching network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:22:15 user nova-compute[75285]: WARNING nova.compute.manager [req-6982fac1-395b-498a-a1da-0482bfad3bb7 req-f96705fe-904b-436c-b60e-25172eb7206c service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received unexpected event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 for instance with vm_state building and task_state spawning.
Nov 10 21:22:15 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:22:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk /opt/stack/data/nova/instances/snapshots/tmptgzk4rml/becd1ed656ed4ad78052c19a2c7c9c05 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk /opt/stack/data/nova/instances/snapshots/tmptgzk4rml/becd1ed656ed4ad78052c19a2c7c9c05" returned: 0 in 0.951s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:16 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Snapshot extracted, beginning image upload
Nov 10 21:22:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-14783995-272f-4d31-b845-060accc06dce req-d678962c-c15b-4043-a3fd-423b44b2d8e8 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received event network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:22:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-14783995-272f-4d31-b845-060accc06dce req-d678962c-c15b-4043-a3fd-423b44b2d8e8 service nova] Acquiring lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-14783995-272f-4d31-b845-060accc06dce req-d678962c-c15b-4043-a3fd-423b44b2d8e8 service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-14783995-272f-4d31-b845-060accc06dce req-d678962c-c15b-4043-a3fd-423b44b2d8e8 service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-14783995-272f-4d31-b845-060accc06dce req-d678962c-c15b-4043-a3fd-423b44b2d8e8 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] No waiting events found dispatching network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:22:16 user nova-compute[75285]: WARNING nova.compute.manager [req-14783995-272f-4d31-b845-060accc06dce req-d678962c-c15b-4043-a3fd-423b44b2d8e8 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received unexpected event network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 21:22:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-8acca061-9cb3-4b7f-a606-b32212525fd0 req-22617b66-8def-4b79-bddc-9f4de0a87567 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:22:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8acca061-9cb3-4b7f-a606-b32212525fd0 req-22617b66-8def-4b79-bddc-9f4de0a87567 service nova] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8acca061-9cb3-4b7f-a606-b32212525fd0 req-22617b66-8def-4b79-bddc-9f4de0a87567 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8acca061-9cb3-4b7f-a606-b32212525fd0 req-22617b66-8def-4b79-bddc-9f4de0a87567 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-8acca061-9cb3-4b7f-a606-b32212525fd0 req-22617b66-8def-4b79-bddc-9f4de0a87567 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] No waiting events found dispatching network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:22:17 user nova-compute[75285]: WARNING nova.compute.manager [req-8acca061-9cb3-4b7f-a606-b32212525fd0 req-22617b66-8def-4b79-bddc-9f4de0a87567 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received unexpected event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 for instance with vm_state building and task_state spawning.
Nov 10 21:22:17 user nova-compute[75285]: DEBUG nova.compute.manager [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:22:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:22:17 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Instance spawned successfully.
Nov 10 21:22:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:22:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:17 user nova-compute[75285]: INFO nova.compute.manager [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Took 6.19 seconds to spawn the instance on the hypervisor.
Nov 10 21:22:17 user nova-compute[75285]: DEBUG nova.compute.manager [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:22:17 user nova-compute[75285]: INFO nova.compute.manager [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Took 62.49 seconds to build instance.
Nov 10 21:22:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1eaf13fd-82a7-47be-bf62-88abafbd44dc tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "f7280d37-4576-488e-ab31-45dddecf2f93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 62.591s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:18 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Snapshot image upload complete
Nov 10 21:22:18 user nova-compute[75285]: DEBUG nova.compute.manager [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:22:19 user nova-compute[75285]: INFO nova.compute.manager [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Shelve offloading
Nov 10 21:22:19 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Instance destroyed successfully.
Nov 10 21:22:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:22:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:22:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquired lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:22:19 user nova-compute[75285]: DEBUG nova.network.neutron [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:22:19 user nova-compute[75285]: DEBUG nova.network.neutron [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updating instance_info_cache with network_info: [{"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:22:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Releasing lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:22:20 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Instance destroyed successfully.
Nov 10 21:22:20 user nova-compute[75285]: DEBUG nova.objects.instance [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'resources' on Instance uuid 63869b5c-443c-4bc6-ac63-f3b559290917 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1135169646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1135169646',id=33,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOTmSqMrfpP4ULBanEmWMIdP/tUpnj4KxwB/AchH+gg4U4S6VjblHfoc+guFOqXeQ9rQFe188DGGYwHi79Xd8dRCfeGh48ucZKaIkvMUU+jkvwLrmTx5ZXfkMjaKFtu2A==',key_name='tempest-keypair-153817456',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:20:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='846fec1848ac4cbfa88b60ba0cf98e3c',ramdisk_id='',reservation_id='r-46g8atv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-605808320',owner_user_name='tempest-AttachVolumeShelveTestJSON-605808320-project-member',shelved_at='2023-11-10T21:22:18.982932',shelved_host='user',shelved_image_id='257ca9f0-5be9-431f-b7f8-ecb244960f27'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51709428ae324620840611f8eb1c216f',uuid=63869b5c-443c-4bc6-ac63-f3b559290917,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converting VIF {"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:f9,bridge_name='br-int',has_traffic_filtering=True,id=a027d49a-f9ca-43fa-af0c-e62afd4e83dc,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa027d49a-f9') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG os_vif [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:f9,bridge_name='br-int',has_traffic_filtering=True,id=a027d49a-f9ca-43fa-af0c-e62afd4e83dc,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa027d49a-f9') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa027d49a-f9, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG nova.compute.manager [req-cbe18524-a95a-49b9-8840-a53f0a913a5b req-97103817-c4bf-4cf9-b791-0c6495c66460 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received event network-changed-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG nova.compute.manager [req-cbe18524-a95a-49b9-8840-a53f0a913a5b req-97103817-c4bf-4cf9-b791-0c6495c66460 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Refreshing instance network info cache due to event network-changed-a027d49a-f9ca-43fa-af0c-e62afd4e83dc. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cbe18524-a95a-49b9-8840-a53f0a913a5b req-97103817-c4bf-4cf9-b791-0c6495c66460 service nova] Acquiring lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cbe18524-a95a-49b9-8840-a53f0a913a5b req-97103817-c4bf-4cf9-b791-0c6495c66460 service nova] Acquired lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG nova.network.neutron [req-cbe18524-a95a-49b9-8840-a53f0a913a5b req-97103817-c4bf-4cf9-b791-0c6495c66460 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Refreshing network info cache for port a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f84c8378-e49e-421e-9146-2e9743dfc6a1) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:20 user nova-compute[75285]: INFO os_vif [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:f9,bridge_name='br-int',has_traffic_filtering=True,id=a027d49a-f9ca-43fa-af0c-e62afd4e83dc,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa027d49a-f9')
Nov 10 21:22:20 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Deleting instance files /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917_del
Nov 10 21:22:20 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Deletion of /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917_del complete
Nov 10 21:22:20 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Deleted allocations for instance 63869b5c-443c-4bc6-ac63-f3b559290917
Nov 10 21:22:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:21 user nova-compute[75285]: DEBUG nova.objects.instance [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'numa_topology' on Instance uuid 63869b5c-443c-4bc6-ac63-f3b559290917 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:22:21 user nova-compute[75285]: DEBUG nova.objects.base [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Object Instance<63869b5c-443c-4bc6-ac63-f3b559290917> lazy-loaded attributes: resources,numa_topology {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:22:21 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:22:21 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:22:21 user nova-compute[75285]: DEBUG nova.network.neutron [req-cbe18524-a95a-49b9-8840-a53f0a913a5b req-97103817-c4bf-4cf9-b791-0c6495c66460 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updated VIF entry in instance network info cache for port a027d49a-f9ca-43fa-af0c-e62afd4e83dc. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:22:21 user nova-compute[75285]: DEBUG nova.network.neutron [req-cbe18524-a95a-49b9-8840-a53f0a913a5b req-97103817-c4bf-4cf9-b791-0c6495c66460 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updating instance_info_cache with network_info: [{"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa027d49a-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:22:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cbe18524-a95a-49b9-8840-a53f0a913a5b req-97103817-c4bf-4cf9-b791-0c6495c66460 service nova] Releasing lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:22:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d8658c3d-76f5-4e6d-8ee3-63630ade7ceb tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "63869b5c-443c-4bc6-ac63-f3b559290917" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.764s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:22:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:22 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:22:22 user nova-compute[75285]: INFO nova.compute.claims [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Claim successful on node user
Nov 10 21:22:23 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:22:23 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:22:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.820s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:23 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:22:23 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:22:23 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:22:23 user nova-compute[75285]: DEBUG nova.policy [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15813044958a4b52866c3273903d12db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61b6bd18de14243b858764031ccd52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:22:23 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:22:23 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:22:23 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:22:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:22:23 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Creating image(s)
Nov 10 21:22:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "/opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "/opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.215s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Successfully created port: 9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk 1073741824" returned: 0 in 0.071s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.205s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Cannot resize image /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Ensure instance console log exists: /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Successfully updated port: 9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "refresh_cache-c9f21f47-2211-4d93-b6e6-7f402ed7bc53" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquired lock "refresh_cache-c9f21f47-2211-4d93-b6e6-7f402ed7bc53" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-57bf0ca5-49b3-4fd7-9d88-dd28632d5cec req-7818f5ae-f26a-4b62-a8c4-8167c6d582fc service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Received event network-changed-9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-57bf0ca5-49b3-4fd7-9d88-dd28632d5cec req-7818f5ae-f26a-4b62-a8c4-8167c6d582fc service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Refreshing instance network info cache due to event network-changed-9587f821-c03c-4088-803c-0d1b6f4e5560. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-57bf0ca5-49b3-4fd7-9d88-dd28632d5cec req-7818f5ae-f26a-4b62-a8c4-8167c6d582fc service nova] Acquiring lock "refresh_cache-c9f21f47-2211-4d93-b6e6-7f402ed7bc53" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Updating instance_info_cache with network_info: [{"id": "9587f821-c03c-4088-803c-0d1b6f4e5560", "address": "fa:16:3e:de:96:40", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9587f821-c0", "ovs_interfaceid": "9587f821-c03c-4088-803c-0d1b6f4e5560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Releasing lock "refresh_cache-c9f21f47-2211-4d93-b6e6-7f402ed7bc53" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Instance network_info: |[{"id": "9587f821-c03c-4088-803c-0d1b6f4e5560", "address": "fa:16:3e:de:96:40", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9587f821-c0", "ovs_interfaceid": "9587f821-c03c-4088-803c-0d1b6f4e5560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-57bf0ca5-49b3-4fd7-9d88-dd28632d5cec req-7818f5ae-f26a-4b62-a8c4-8167c6d582fc service nova] Acquired lock "refresh_cache-c9f21f47-2211-4d93-b6e6-7f402ed7bc53" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.network.neutron [req-57bf0ca5-49b3-4fd7-9d88-dd28632d5cec req-7818f5ae-f26a-4b62-a8c4-8167c6d582fc service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Refreshing network info cache for port 9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Start _get_guest_xml network_info=[{"id": "9587f821-c03c-4088-803c-0d1b6f4e5560", "address": "fa:16:3e:de:96:40", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9587f821-c0", "ovs_interfaceid": "9587f821-c03c-4088-803c-0d1b6f4e5560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:22:25 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:22:25 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1079720583',display_name='tempest-VolumesSnapshotTestJSON-instance-1079720583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1079720583',id=36,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxsX/MzcioMz8KqrJzswseS1leqI6lhEf62sUCVSqztxJxsMPNF3jGP0BMfqFZHnRspHZDgV22T9SvhfCOEmiOCYENBUVTDMJNRAY1+TE79H+6q7XHQRGCdpQFxTgCGfg==',key_name='tempest-keypair-148056767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b61b6bd18de14243b858764031ccd52b',ramdisk_id='',reservation_id='r-ehbnr7op',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1530341723',owner_user_name='tempest-VolumesSnapshotTestJSON-1530341723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15813044958a4b52866c3273903d12db',uuid=c9f21f47-2211-4d93-b6e6-7f402ed7bc53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9587f821-c03c-4088-803c-0d1b6f4e5560", "address": "fa:16:3e:de:96:40", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9587f821-c0", "ovs_interfaceid": "9587f821-c03c-4088-803c-0d1b6f4e5560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Converting VIF {"id": "9587f821-c03c-4088-803c-0d1b6f4e5560", "address": "fa:16:3e:de:96:40", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9587f821-c0", "ovs_interfaceid": "9587f821-c03c-4088-803c-0d1b6f4e5560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:96:40,bridge_name='br-int',has_traffic_filtering=True,id=9587f821-c03c-4088-803c-0d1b6f4e5560,network=Network(310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9587f821-c0') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lazy-loading 'pci_devices' on Instance uuid c9f21f47-2211-4d93-b6e6-7f402ed7bc53 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:22:25 user nova-compute[75285]:   <uuid>c9f21f47-2211-4d93-b6e6-7f402ed7bc53</uuid>
Nov 10 21:22:25 user nova-compute[75285]:   <name>instance-00000024</name>
Nov 10 21:22:25 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:22:25 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:22:25 user nova-compute[75285]:   <metadata>
Nov 10 21:22:25 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:22:25 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:22:25 user nova-compute[75285]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1079720583</nova:name>
Nov 10 21:22:25 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:22:25</nova:creationTime>
Nov 10 21:22:25 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:22:25 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:22:25 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:22:25 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:22:25 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:22:25 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:22:25 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:22:25 user nova-compute[75285]:       <nova:owner>
Nov 10 21:22:25 user nova-compute[75285]:         <nova:user uuid="15813044958a4b52866c3273903d12db">tempest-VolumesSnapshotTestJSON-1530341723-project-member</nova:user>
Nov 10 21:22:25 user nova-compute[75285]:         <nova:project uuid="b61b6bd18de14243b858764031ccd52b">tempest-VolumesSnapshotTestJSON-1530341723</nova:project>
Nov 10 21:22:25 user nova-compute[75285]:       </nova:owner>
Nov 10 21:22:25 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:22:25 user nova-compute[75285]:       <nova:ports>
Nov 10 21:22:25 user nova-compute[75285]:         <nova:port uuid="9587f821-c03c-4088-803c-0d1b6f4e5560">
Nov 10 21:22:25 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 21:22:25 user nova-compute[75285]:         </nova:port>
Nov 10 21:22:25 user nova-compute[75285]:       </nova:ports>
Nov 10 21:22:25 user nova-compute[75285]:     </nova:instance>
Nov 10 21:22:25 user nova-compute[75285]:   </metadata>
Nov 10 21:22:25 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:22:25 user nova-compute[75285]:     <system>
Nov 10 21:22:25 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:22:25 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:22:25 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:22:25 user nova-compute[75285]:       <entry name="serial">c9f21f47-2211-4d93-b6e6-7f402ed7bc53</entry>
Nov 10 21:22:25 user nova-compute[75285]:       <entry name="uuid">c9f21f47-2211-4d93-b6e6-7f402ed7bc53</entry>
Nov 10 21:22:25 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:22:25 user nova-compute[75285]:     </system>
Nov 10 21:22:25 user nova-compute[75285]:   </sysinfo>
Nov 10 21:22:25 user nova-compute[75285]:   <os>
Nov 10 21:22:25 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:22:25 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:22:25 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:22:25 user nova-compute[75285]:   </os>
Nov 10 21:22:25 user nova-compute[75285]:   <features>
Nov 10 21:22:25 user nova-compute[75285]:     <acpi/>
Nov 10 21:22:25 user nova-compute[75285]:     <apic/>
Nov 10 21:22:25 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:22:25 user nova-compute[75285]:   </features>
Nov 10 21:22:25 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:22:25 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:22:25 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:22:25 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:22:25 user nova-compute[75285]:   </clock>
Nov 10 21:22:25 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:22:25 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:22:25 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:22:25 user nova-compute[75285]:   </cpu>
Nov 10 21:22:25 user nova-compute[75285]:   <devices>
Nov 10 21:22:25 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:22:25 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:22:25 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk"/>
Nov 10 21:22:25 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:22:25 user nova-compute[75285]:     </disk>
Nov 10 21:22:25 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:22:25 user nova-compute[75285]:       <mac address="fa:16:3e:de:96:40"/>
Nov 10 21:22:25 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:22:25 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:22:25 user nova-compute[75285]:       <target dev="tap9587f821-c0"/>
Nov 10 21:22:25 user nova-compute[75285]:     </interface>
Nov 10 21:22:25 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:22:25 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/console.log" append="off"/>
Nov 10 21:22:25 user nova-compute[75285]:     </serial>
Nov 10 21:22:25 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:22:25 user nova-compute[75285]:     <video>
Nov 10 21:22:25 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:22:25 user nova-compute[75285]:     </video>
Nov 10 21:22:25 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:22:25 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:22:25 user nova-compute[75285]:     </rng>
Nov 10 21:22:25 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:22:25 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:22:25 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:22:25 user nova-compute[75285]:     </memballoon>
Nov 10 21:22:25 user nova-compute[75285]:   </devices>
Nov 10 21:22:25 user nova-compute[75285]: </domain>
Nov 10 21:22:25 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1079720583',display_name='tempest-VolumesSnapshotTestJSON-instance-1079720583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1079720583',id=36,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxsX/MzcioMz8KqrJzswseS1leqI6lhEf62sUCVSqztxJxsMPNF3jGP0BMfqFZHnRspHZDgV22T9SvhfCOEmiOCYENBUVTDMJNRAY1+TE79H+6q7XHQRGCdpQFxTgCGfg==',key_name='tempest-keypair-148056767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b61b6bd18de14243b858764031ccd52b',ramdisk_id='',reservation_id='r-ehbnr7op',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1530341723',owner_user_name='tempest-VolumesSnapshotTestJSON-1530341723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15813044958a4b52866c3273903d12db',uuid=c9f21f47-2211-4d93-b6e6-7f402ed7bc53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9587f821-c03c-4088-803c-0d1b6f4e5560", "address": "fa:16:3e:de:96:40", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9587f821-c0", "ovs_interfaceid": "9587f821-c03c-4088-803c-0d1b6f4e5560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Converting VIF {"id": "9587f821-c03c-4088-803c-0d1b6f4e5560", "address": "fa:16:3e:de:96:40", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9587f821-c0", "ovs_interfaceid": "9587f821-c03c-4088-803c-0d1b6f4e5560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:96:40,bridge_name='br-int',has_traffic_filtering=True,id=9587f821-c03c-4088-803c-0d1b6f4e5560,network=Network(310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9587f821-c0') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG os_vif [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:96:40,bridge_name='br-int',has_traffic_filtering=True,id=9587f821-c03c-4088-803c-0d1b6f4e5560,network=Network(310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9587f821-c0') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '632f06e3-cd59-5eef-9d5f-64d026d8302d', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9587f821-c0, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9587f821-c0, col_values=(('qos', UUID('25bcd6b5-9c20-4dd6-8e68-a654a8f1b3ab')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9587f821-c0, col_values=(('external_ids', {'iface-id': '9587f821-c03c-4088-803c-0d1b6f4e5560', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:96:40', 'vm-uuid': 'c9f21f47-2211-4d93-b6e6-7f402ed7bc53'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:25 user nova-compute[75285]: INFO os_vif [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:96:40,bridge_name='br-int',has_traffic_filtering=True,id=9587f821-c03c-4088-803c-0d1b6f4e5560,network=Network(310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9587f821-c0')
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:22:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] No VIF found with MAC fa:16:3e:de:96:40, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:22:26 user nova-compute[75285]: DEBUG nova.network.neutron [req-57bf0ca5-49b3-4fd7-9d88-dd28632d5cec req-7818f5ae-f26a-4b62-a8c4-8167c6d582fc service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Updated VIF entry in instance network info cache for port 9587f821-c03c-4088-803c-0d1b6f4e5560. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:22:26 user nova-compute[75285]: DEBUG nova.network.neutron [req-57bf0ca5-49b3-4fd7-9d88-dd28632d5cec req-7818f5ae-f26a-4b62-a8c4-8167c6d582fc service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Updating instance_info_cache with network_info: [{"id": "9587f821-c03c-4088-803c-0d1b6f4e5560", "address": "fa:16:3e:de:96:40", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9587f821-c0", "ovs_interfaceid": "9587f821-c03c-4088-803c-0d1b6f4e5560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:22:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-57bf0ca5-49b3-4fd7-9d88-dd28632d5cec req-7818f5ae-f26a-4b62-a8c4-8167c6d582fc service nova] Releasing lock "refresh_cache-c9f21f47-2211-4d93-b6e6-7f402ed7bc53" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:22:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-d8516883-0c47-46f2-ab27-86ffcbd68019 req-d357da42-b874-4f52-8060-8b282b125fb9 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Received event network-vif-plugged-9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:22:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d8516883-0c47-46f2-ab27-86ffcbd68019 req-d357da42-b874-4f52-8060-8b282b125fb9 service nova] Acquiring lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d8516883-0c47-46f2-ab27-86ffcbd68019 req-d357da42-b874-4f52-8060-8b282b125fb9 service nova] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d8516883-0c47-46f2-ab27-86ffcbd68019 req-d357da42-b874-4f52-8060-8b282b125fb9 service nova] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-d8516883-0c47-46f2-ab27-86ffcbd68019 req-d357da42-b874-4f52-8060-8b282b125fb9 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] No waiting events found dispatching network-vif-plugged-9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:22:27 user nova-compute[75285]: WARNING nova.compute.manager [req-d8516883-0c47-46f2-ab27-86ffcbd68019 req-d357da42-b874-4f52-8060-8b282b125fb9 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Received unexpected event network-vif-plugged-9587f821-c03c-4088-803c-0d1b6f4e5560 for instance with vm_state building and task_state spawning.
Nov 10 21:22:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:22:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:22:29 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Instance spawned successfully.
Nov 10 21:22:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:22:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:22:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-9739e28c-8ac5-49b4-8f42-2cba6edda595 req-c35975d2-c288-4ce4-b27e-7738ef2123f5 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Received event network-vif-plugged-9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:22:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9739e28c-8ac5-49b4-8f42-2cba6edda595 req-c35975d2-c288-4ce4-b27e-7738ef2123f5 service nova] Acquiring lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9739e28c-8ac5-49b4-8f42-2cba6edda595 req-c35975d2-c288-4ce4-b27e-7738ef2123f5 service nova] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9739e28c-8ac5-49b4-8f42-2cba6edda595 req-c35975d2-c288-4ce4-b27e-7738ef2123f5 service nova] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-9739e28c-8ac5-49b4-8f42-2cba6edda595 req-c35975d2-c288-4ce4-b27e-7738ef2123f5 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] No waiting events found dispatching network-vif-plugged-9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:22:29 user nova-compute[75285]: WARNING nova.compute.manager [req-9739e28c-8ac5-49b4-8f42-2cba6edda595 req-c35975d2-c288-4ce4-b27e-7738ef2123f5 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Received unexpected event network-vif-plugged-9587f821-c03c-4088-803c-0d1b6f4e5560 for instance with vm_state building and task_state spawning.
Nov 10 21:22:29 user nova-compute[75285]: INFO nova.compute.manager [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 10 21:22:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:22:29 user nova-compute[75285]: INFO nova.compute.manager [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Took 7.51 seconds to build instance.
Nov 10 21:22:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8ac79175-b6c8-448a-bf6f-afb4a1f6b61d tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.622s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:42 user nova-compute[75285]: DEBUG nova.compute.manager [req-effb2d2d-c07d-45c0-a233-e54e1a7ef882 req-642ff8c0-a113-40d3-9edb-45a92faa5297 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Received event network-changed-4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:22:42 user nova-compute[75285]: DEBUG nova.compute.manager [req-effb2d2d-c07d-45c0-a233-e54e1a7ef882 req-642ff8c0-a113-40d3-9edb-45a92faa5297 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Refreshing instance network info cache due to event network-changed-4956aff6-094a-4b0d-92f5-d270b683c547. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:22:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-effb2d2d-c07d-45c0-a233-e54e1a7ef882 req-642ff8c0-a113-40d3-9edb-45a92faa5297 service nova] Acquiring lock "refresh_cache-61cc694d-55cf-4492-bd5f-b65c733da4ba" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:22:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-effb2d2d-c07d-45c0-a233-e54e1a7ef882 req-642ff8c0-a113-40d3-9edb-45a92faa5297 service nova] Acquired lock "refresh_cache-61cc694d-55cf-4492-bd5f-b65c733da4ba" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:22:42 user nova-compute[75285]: DEBUG nova.network.neutron [req-effb2d2d-c07d-45c0-a233-e54e1a7ef882 req-642ff8c0-a113-40d3-9edb-45a92faa5297 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Refreshing network info cache for port 4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG nova.network.neutron [req-effb2d2d-c07d-45c0-a233-e54e1a7ef882 req-642ff8c0-a113-40d3-9edb-45a92faa5297 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Updated VIF entry in instance network info cache for port 4956aff6-094a-4b0d-92f5-d270b683c547. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG nova.network.neutron [req-effb2d2d-c07d-45c0-a233-e54e1a7ef882 req-642ff8c0-a113-40d3-9edb-45a92faa5297 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Updating instance_info_cache with network_info: [{"id": "4956aff6-094a-4b0d-92f5-d270b683c547", "address": "fa:16:3e:3e:ee:00", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4956aff6-09", "ovs_interfaceid": "4956aff6-094a-4b0d-92f5-d270b683c547", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-effb2d2d-c07d-45c0-a233-e54e1a7ef882 req-642ff8c0-a113-40d3-9edb-45a92faa5297 service nova] Releasing lock "refresh_cache-61cc694d-55cf-4492-bd5f-b65c733da4ba" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-7a0fdcb1-95c1-45e7-b2dd-470b4ae69e1d req-48700171-4f95-4a63-a994-5c3136af00af service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Received event network-changed-4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-7a0fdcb1-95c1-45e7-b2dd-470b4ae69e1d req-48700171-4f95-4a63-a994-5c3136af00af service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Refreshing instance network info cache due to event network-changed-4956aff6-094a-4b0d-92f5-d270b683c547. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7a0fdcb1-95c1-45e7-b2dd-470b4ae69e1d req-48700171-4f95-4a63-a994-5c3136af00af service nova] Acquiring lock "refresh_cache-61cc694d-55cf-4492-bd5f-b65c733da4ba" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7a0fdcb1-95c1-45e7-b2dd-470b4ae69e1d req-48700171-4f95-4a63-a994-5c3136af00af service nova] Acquired lock "refresh_cache-61cc694d-55cf-4492-bd5f-b65c733da4ba" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG nova.network.neutron [req-7a0fdcb1-95c1-45e7-b2dd-470b4ae69e1d req-48700171-4f95-4a63-a994-5c3136af00af service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Refreshing network info cache for port 4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "61cc694d-55cf-4492-bd5f-b65c733da4ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "61cc694d-55cf-4492-bd5f-b65c733da4ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:43 user nova-compute[75285]: INFO nova.compute.manager [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Terminating instance
Nov 10 21:22:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-158ab395-8a9a-4616-94ac-4fc0d03c90b0 req-f541a4fe-30ef-4e80-b1ef-41429ec826b8 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Received event network-vif-unplugged-4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-158ab395-8a9a-4616-94ac-4fc0d03c90b0 req-f541a4fe-30ef-4e80-b1ef-41429ec826b8 service nova] Acquiring lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-158ab395-8a9a-4616-94ac-4fc0d03c90b0 req-f541a4fe-30ef-4e80-b1ef-41429ec826b8 service nova] Lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-158ab395-8a9a-4616-94ac-4fc0d03c90b0 req-f541a4fe-30ef-4e80-b1ef-41429ec826b8 service nova] Lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-158ab395-8a9a-4616-94ac-4fc0d03c90b0 req-f541a4fe-30ef-4e80-b1ef-41429ec826b8 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] No waiting events found dispatching network-vif-unplugged-4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:22:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-158ab395-8a9a-4616-94ac-4fc0d03c90b0 req-f541a4fe-30ef-4e80-b1ef-41429ec826b8 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Received event network-vif-unplugged-4956aff6-094a-4b0d-92f5-d270b683c547 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG nova.network.neutron [req-7a0fdcb1-95c1-45e7-b2dd-470b4ae69e1d req-48700171-4f95-4a63-a994-5c3136af00af service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Updated VIF entry in instance network info cache for port 4956aff6-094a-4b0d-92f5-d270b683c547. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG nova.network.neutron [req-7a0fdcb1-95c1-45e7-b2dd-470b4ae69e1d req-48700171-4f95-4a63-a994-5c3136af00af service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Updating instance_info_cache with network_info: [{"id": "4956aff6-094a-4b0d-92f5-d270b683c547", "address": "fa:16:3e:3e:ee:00", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4956aff6-09", "ovs_interfaceid": "4956aff6-094a-4b0d-92f5-d270b683c547", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7a0fdcb1-95c1-45e7-b2dd-470b4ae69e1d req-48700171-4f95-4a63-a994-5c3136af00af service nova] Releasing lock "refresh_cache-61cc694d-55cf-4492-bd5f-b65c733da4ba" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Instance destroyed successfully.
Nov 10 21:22:44 user nova-compute[75285]: DEBUG nova.objects.instance [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lazy-loading 'resources' on Instance uuid 61cc694d-55cf-4492-bd5f-b65c733da4ba {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-34115249',display_name='tempest-TestVolumeBootPattern-server-34115249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-34115249',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAAoUPxLI+zueb7o2tu1JS76f604TN+uq+pfg2zYS5MbkMZtx1Ub2kBFu6OB71sTNt8tpmOHljKAgKzRpBKVdyr/VTj1zgWyamAFtpMuzpYAL+WhfMApRgNi/CTwdcWlw==',key_name='tempest-TestVolumeBootPattern-2083573923',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:21:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04636b8a9e404d40a3a2bc9f63a4df8c',ramdisk_id='',reservation_id='r-kehhth01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1962512242',owner_user_name='tempest-TestVolumeBootPattern-1962512242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:21:27Z,user_data=None,user_id='e16c471c0875416aa0eb86d89eef3a27',uuid=61cc694d-55cf-4492-bd5f-b65c733da4ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4956aff6-094a-4b0d-92f5-d270b683c547", "address": "fa:16:3e:3e:ee:00", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4956aff6-09", "ovs_interfaceid": "4956aff6-094a-4b0d-92f5-d270b683c547", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converting VIF {"id": "4956aff6-094a-4b0d-92f5-d270b683c547", "address": "fa:16:3e:3e:ee:00", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4956aff6-09", "ovs_interfaceid": "4956aff6-094a-4b0d-92f5-d270b683c547", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:ee:00,bridge_name='br-int',has_traffic_filtering=True,id=4956aff6-094a-4b0d-92f5-d270b683c547,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4956aff6-09') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_vif [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:ee:00,bridge_name='br-int',has_traffic_filtering=True,id=4956aff6-094a-4b0d-92f5-d270b683c547,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4956aff6-09') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4956aff6-09, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43fb45e2-b7f6-4962-a56e-a3fef4e759d9) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:44 user nova-compute[75285]: INFO os_vif [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:ee:00,bridge_name='br-int',has_traffic_filtering=True,id=4956aff6-094a-4b0d-92f5-d270b683c547,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4956aff6-09')
Nov 10 21:22:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BagbvNEI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:22:44 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[561c4e2f-479f-41f3-b76e-a9efd94d6e4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:22:44 user nova-compute[75285]: No targets found.
Nov 10 21:22:44 user nova-compute[75285]: iSNS:
Nov 10 21:22:44 user nova-compute[75285]: No targets found.
Nov 10 21:22:44 user nova-compute[75285]: STATIC:
Nov 10 21:22:44 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:22:44 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:22:44 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:22:44 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c
Nov 10 21:22:44 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:22:44 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:22:44 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845
Nov 10 21:22:44 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:22:44 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:22:44 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9
Nov 10 21:22:44 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:22:44 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:22:44 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd
Nov 10 21:22:44 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:22:44 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:22:44 user nova-compute[75285]: FIRMWARE:
Nov 10 21:22:44 user nova-compute[75285]: No targets found.
Nov 10 21:22:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:22:44 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:22:44 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6489d4-c5da-43c8-b01a-3659664069dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[767442df-371e-48a9-86c8-b454888f65ca]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:22:44 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:22:44 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:22:44 user nova-compute[75285]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 (non-flash)
Nov 10 21:22:44 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:22:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:22:44 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:22:44 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:22:44 user nova-compute[75285]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 (non-flash)
Nov 10 21:22:44 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:22:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e4503640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845'): ({'sdd'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Removing single pathed devices sdd {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[94697251-56ca-4c38-8036-db58a6e64015]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b36b55-2191-4323-8569-40feb2038cce]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Flushing IO for device /dev/sdd {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bda7c9-79bb-41a8-a36b-12ad54f771c3]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34c3047-b6b2-4836-aa2e-c9648eb04c8a]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] SCSI volumes sdd have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5468a65d-088f-4730-ae1e-48fa906413e4]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9835217-e5bd-41c1-ad22-7ffcb329a8cf]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845, portal: 172.16.0.220,3260]
Nov 10 21:22:44 user nova-compute[75285]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845, portal: 172.16.0.220,3260] successful.
Nov 10 21:22:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e67fe5-c80f-4955-864b-23d9bd58f845 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d147152-fb29-46b9-be53-63dd6359f1e0]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] <== disconnect_volume: return (358ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:22:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Deleting instance files /opt/stack/data/nova/instances/61cc694d-55cf-4492-bd5f-b65c733da4ba_del
Nov 10 21:22:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Deletion of /opt/stack/data/nova/instances/61cc694d-55cf-4492-bd5f-b65c733da4ba_del complete
Nov 10 21:22:44 user nova-compute[75285]: INFO nova.compute.manager [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 10 21:22:44 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:22:44 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:22:45 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:22:45 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Took 0.52 seconds to deallocate network for instance.
Nov 10 21:22:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-8df67d90-ec5a-44cc-a374-5e69fa8f9960 req-84e6bb4b-4455-4f34-a54e-f4a6826e80a6 service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Received event network-vif-deleted-4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:22:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d29786e-dd7f-4439-a364-671e6f7dfcac req-57ca0ee0-0dd1-4107-908b-fe4d08c8fe8c service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Received event network-vif-plugged-4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:22:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d29786e-dd7f-4439-a364-671e6f7dfcac req-57ca0ee0-0dd1-4107-908b-fe4d08c8fe8c service nova] Acquiring lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d29786e-dd7f-4439-a364-671e6f7dfcac req-57ca0ee0-0dd1-4107-908b-fe4d08c8fe8c service nova] Lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d29786e-dd7f-4439-a364-671e6f7dfcac req-57ca0ee0-0dd1-4107-908b-fe4d08c8fe8c service nova] Lock "61cc694d-55cf-4492-bd5f-b65c733da4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d29786e-dd7f-4439-a364-671e6f7dfcac req-57ca0ee0-0dd1-4107-908b-fe4d08c8fe8c service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] No waiting events found dispatching network-vif-plugged-4956aff6-094a-4b0d-92f5-d270b683c547 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:22:45 user nova-compute[75285]: WARNING nova.compute.manager [req-1d29786e-dd7f-4439-a364-671e6f7dfcac req-57ca0ee0-0dd1-4107-908b-fe4d08c8fe8c service nova] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Received unexpected event network-vif-plugged-4956aff6-094a-4b0d-92f5-d270b683c547 for instance with vm_state active and task_state deleting.
Nov 10 21:22:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:47 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:22:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:51 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:22:51 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:22:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:22:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:22:51 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:22:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:52 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updating instance_info_cache with network_info: [{"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:22:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:22:52 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:22:52 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:22:52 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:22:52 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:22:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:22:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:22:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:53 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:22:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:22:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:22:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:22:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:22:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:22:56 user nova-compute[75285]: INFO nova.compute.manager [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: 61cc694d-55cf-4492-bd5f-b65c733da4ba] Took 11.09 seconds to detach 1 volumes for instance.
Nov 10 21:22:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:22:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:22:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:56 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:22:56 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:22:56 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=7762MB free_disk=24.967636108398438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:22:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.340s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:22:57 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Deleted allocations for instance 61cc694d-55cf-4492-bd5f-b65c733da4ba
Nov 10 21:22:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ce1c2db3-94bc-44a3-b810-14feed8dcba5 tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "61cc694d-55cf-4492-bd5f-b65c733da4ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.908s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ef5f5450-aef1-48f8-b2c0-617d4fb1803d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance aeb029de-eec7-4b68-904a-6bca29f2cfad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c7933247-e939-4ede-a431-e91488332000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance f7280d37-4576-488e-ab31-45dddecf2f93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 7abac387-cc1d-4f17-9698-ea7db05489b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c9f21f47-2211-4d93-b6e6-7f402ed7bc53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:22:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:22:58 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:22:58 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:22:58 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:22:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:22:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:04 user nova-compute[75285]: INFO nova.compute.manager [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Detaching volume 43c87b96-d1cb-4ee8-8509-ae86d53b3cbd
Nov 10 21:23:04 user nova-compute[75285]: INFO nova.virt.block_device [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Attempting to driver detach volume 43c87b96-d1cb-4ee8-8509-ae86d53b3cbd from mountpoint /dev/vdb
Nov 10 21:23:04 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Attempting to detach device vdb from instance aeb029de-eec7-4b68-904a-6bca29f2cfad from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:23:04 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:23:04 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:23:04 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:23:04 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:23:04 user nova-compute[75285]:   <serial>43c87b96-d1cb-4ee8-8509-ae86d53b3cbd</serial>
Nov 10 21:23:04 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 21:23:04 user nova-compute[75285]: </disk>
Nov 10 21:23:04 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:23:04 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Successfully detached device vdb from instance aeb029de-eec7-4b68-904a-6bca29f2cfad from the persistent domain config.
Nov 10 21:23:04 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aeb029de-eec7-4b68-904a-6bca29f2cfad from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:23:04 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:23:04 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:23:04 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:23:04 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:23:04 user nova-compute[75285]:   <serial>43c87b96-d1cb-4ee8-8509-ae86d53b3cbd</serial>
Nov 10 21:23:04 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 21:23:04 user nova-compute[75285]: </disk>
Nov 10 21:23:04 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:23:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aeb029de-eec7-4b68-904a-6bca29f2cfad {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:23:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:23:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:23:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:23:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:23:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:23:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:23:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:25 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aeb029de-eec7-4b68-904a-6bca29f2cfad is timed out.
Nov 10 21:23:25 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Successfully detached device vdb from instance aeb029de-eec7-4b68-904a-6bca29f2cfad from the live domain config.
Nov 10 21:23:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIXdgROa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:23:25 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2dcdbe-f818-40bf-876e-3770263b2e91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:23:25 user nova-compute[75285]: No targets found.
Nov 10 21:23:25 user nova-compute[75285]: iSNS:
Nov 10 21:23:25 user nova-compute[75285]: No targets found.
Nov 10 21:23:25 user nova-compute[75285]: STATIC:
Nov 10 21:23:25 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:23:25 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:23:25 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:23:25 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c
Nov 10 21:23:25 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:23:25 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:23:25 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9
Nov 10 21:23:25 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:23:25 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:23:25 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd
Nov 10 21:23:25 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:23:25 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:23:25 user nova-compute[75285]: FIRMWARE:
Nov 10 21:23:25 user nova-compute[75285]: No targets found.
Nov 10 21:23:25 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:23:25 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:23:25 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[624e32dc-1d60-4c60-9014-3b6f93971daa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a85eec-4313-4d34-b0ba-17b0526f5741]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:23:25 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:23:25 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:23:25 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:23:25 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:23:25 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:23:25 user nova-compute[75285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd (non-flash)
Nov 10 21:23:25 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:23:25 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e46dcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e1ec8b-829c-45e1-9f72-d2c135335ded]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2303ab5c-94fb-4d32-8edc-7a861eb14a90]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bcfe48-2768-4f0b-8376-3682d61ea614]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5a8ad5-b5f8-4570-bf47-838262ebbae0]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4504d3e9-9d9d-4aea-81ff-a03a41947a38]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5005df9e-dff7-40cd-8a91-5fe59ba25225]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260]
Nov 10 21:23:25 user nova-compute[75285]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd, portal: 172.16.0.220,3260] successful.
Nov 10 21:23:25 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c87b96-d1cb-4ee8-8509-ae86d53b3cbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd752b6-26de-42f8-81df-a2f86487c881]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] <== disconnect_volume: return (331ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:23:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:23:26 user nova-compute[75285]: DEBUG nova.objects.instance [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lazy-loading 'flavor' on Instance uuid aeb029de-eec7-4b68-904a-6bca29f2cfad {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:23:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-0a44781b-1f86-43ee-836b-56029121e344 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.054s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:23:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:23:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:23:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:23:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:23:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:23:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:23:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:23:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:43 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:23:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 21:23:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] There are 0 instances to clean {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 21:23:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:23:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "7abac387-cc1d-4f17-9698-ea7db05489b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:44 user nova-compute[75285]: INFO nova.compute.manager [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Terminating instance
Nov 10 21:23:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:23:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-88128f09-8795-4e4d-9e69-65b74fb307af req-0e2f356b-3962-4929-ab01-ed20e6da22e6 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received event network-vif-unplugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-88128f09-8795-4e4d-9e69-65b74fb307af req-0e2f356b-3962-4929-ab01-ed20e6da22e6 service nova] Acquiring lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-88128f09-8795-4e4d-9e69-65b74fb307af req-0e2f356b-3962-4929-ab01-ed20e6da22e6 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-88128f09-8795-4e4d-9e69-65b74fb307af req-0e2f356b-3962-4929-ab01-ed20e6da22e6 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-88128f09-8795-4e4d-9e69-65b74fb307af req-0e2f356b-3962-4929-ab01-ed20e6da22e6 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] No waiting events found dispatching network-vif-unplugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-88128f09-8795-4e4d-9e69-65b74fb307af req-0e2f356b-3962-4929-ab01-ed20e6da22e6 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received event network-vif-unplugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:45 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Instance destroyed successfully.
Nov 10 21:23:45 user nova-compute[75285]: DEBUG nova.objects.instance [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lazy-loading 'resources' on Instance uuid 7abac387-cc1d-4f17-9698-ea7db05489b2 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1879305195',display_name='tempest-VolumesActionsTest-instance-1879305195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1879305195',id=35,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:22:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbd29a6eea20479c817a2d10d68d474c',ramdisk_id='',reservation_id='r-8cn2d2lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-115087691',owner_user_name='tempest-VolumesActionsTest-115087691-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:22:02Z,user_data=None,user_id='cd355e7ffc524aceb404b0dc3da858ed',uuid=7abac387-cc1d-4f17-9698-ea7db05489b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "address": "fa:16:3e:db:33:cb", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3941e-ea", "ovs_interfaceid": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Converting VIF {"id": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "address": "fa:16:3e:db:33:cb", "network": {"id": "bf1a11ae-8cfd-4986-985c-b8b237922d92", "bridge": "br-int", "label": "tempest-VolumesActionsTest-452248081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbd29a6eea20479c817a2d10d68d474c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea3941e-ea", "ovs_interfaceid": "8ea3941e-eac0-4125-a5a0-0bbc50e3b832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:33:cb,bridge_name='br-int',has_traffic_filtering=True,id=8ea3941e-eac0-4125-a5a0-0bbc50e3b832,network=Network(bf1a11ae-8cfd-4986-985c-b8b237922d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3941e-ea') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG os_vif [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:33:cb,bridge_name='br-int',has_traffic_filtering=True,id=8ea3941e-eac0-4125-a5a0-0bbc50e3b832,network=Network(bf1a11ae-8cfd-4986-985c-b8b237922d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3941e-ea') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ea3941e-ea, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07961e6d-18e5-410e-8a57-ef102a63a003) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:23:45 user nova-compute[75285]: INFO os_vif [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:33:cb,bridge_name='br-int',has_traffic_filtering=True,id=8ea3941e-eac0-4125-a5a0-0bbc50e3b832,network=Network(bf1a11ae-8cfd-4986-985c-b8b237922d92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea3941e-ea')
Nov 10 21:23:45 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Deleting instance files /opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2_del
Nov 10 21:23:45 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Deletion of /opt/stack/data/nova/instances/7abac387-cc1d-4f17-9698-ea7db05489b2_del complete
Nov 10 21:23:45 user nova-compute[75285]: INFO nova.compute.manager [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 10 21:23:45 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:46 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:23:46 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Took 0.84 seconds to deallocate network for instance.
Nov 10 21:23:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-40b1879c-3c3f-4f34-a5a2-5897b5d9f018 req-655f6324-a5d1-4067-b2d8-a6ed0f9b6304 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received event network-vif-deleted-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:23:46 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:23:46 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:23:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:46 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Deleted allocations for instance 7abac387-cc1d-4f17-9698-ea7db05489b2
Nov 10 21:23:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-be759e17-d0f0-40c5-9d5d-e36234013607 tempest-VolumesActionsTest-115087691 tempest-VolumesActionsTest-115087691-project-member] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.192s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received event network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Acquiring lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] No waiting events found dispatching network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:23:47 user nova-compute[75285]: WARNING nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received unexpected event network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 for instance with vm_state deleted and task_state None.
Nov 10 21:23:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received event network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Acquiring lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] No waiting events found dispatching network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:23:47 user nova-compute[75285]: WARNING nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received unexpected event network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 for instance with vm_state deleted and task_state None.
Nov 10 21:23:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received event network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Acquiring lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] No waiting events found dispatching network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:23:47 user nova-compute[75285]: WARNING nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received unexpected event network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 for instance with vm_state deleted and task_state None.
Nov 10 21:23:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received event network-vif-unplugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Acquiring lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] No waiting events found dispatching network-vif-unplugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:23:47 user nova-compute[75285]: WARNING nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received unexpected event network-vif-unplugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 for instance with vm_state deleted and task_state None.
Nov 10 21:23:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received event network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Acquiring lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] Lock "7abac387-cc1d-4f17-9698-ea7db05489b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] No waiting events found dispatching network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:23:47 user nova-compute[75285]: WARNING nova.compute.manager [req-d870cedc-5130-4382-a818-e2c5988ff56c req-9488c60a-2216-4329-a32d-e0e7a8e6fa83 service nova] [instance: 7abac387-cc1d-4f17-9698-ea7db05489b2] Received unexpected event network-vif-plugged-8ea3941e-eac0-4125-a5a0-0bbc50e3b832 for instance with vm_state deleted and task_state None.
Nov 10 21:23:47 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:23:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:51 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:23:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:23:53 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:23:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:23:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:23:53 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Updating instance_info_cache with network_info: [{"id": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "address": "fa:16:3e:ef:5a:f0", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496278-f4", "ovs_interfaceid": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:55 user nova-compute[75285]: INFO nova.compute.manager [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Terminating instance
Nov 10 21:23:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG nova.compute.manager [req-3d72aee3-1406-4ad0-a7bb-942a43aac2b2 req-133678a0-074f-4145-99e1-7b6086d0dccb service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received event network-vif-unplugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3d72aee3-1406-4ad0-a7bb-942a43aac2b2 req-133678a0-074f-4145-99e1-7b6086d0dccb service nova] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3d72aee3-1406-4ad0-a7bb-942a43aac2b2 req-133678a0-074f-4145-99e1-7b6086d0dccb service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3d72aee3-1406-4ad0-a7bb-942a43aac2b2 req-133678a0-074f-4145-99e1-7b6086d0dccb service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG nova.compute.manager [req-3d72aee3-1406-4ad0-a7bb-942a43aac2b2 req-133678a0-074f-4145-99e1-7b6086d0dccb service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] No waiting events found dispatching network-vif-unplugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG nova.compute.manager [req-3d72aee3-1406-4ad0-a7bb-942a43aac2b2 req-133678a0-074f-4145-99e1-7b6086d0dccb service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received event network-vif-unplugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:56 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Instance destroyed successfully.
Nov 10 21:23:56 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lazy-loading 'resources' on Instance uuid aeb029de-eec7-4b68-904a-6bca29f2cfad {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T21:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1344900563',display_name='tempest-ServerActionsTestOtherA-server-27154683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1344900563',id=29,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCxz8/kJz7qMuJbbL+KhjPzwEhpgkXsTZPfLxJMquouIKyOErI7tWXMR4fRwx1eDtPTfwTq81cvUjsQcmjJRTEGBLbNgsXVL83Z8Zpp2H9OVcF/7u80FuAIt3FNaKBzxw==',key_name='tempest-keypair-2088221850',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:20:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-xjx70px8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:20:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=aeb029de-eec7-4b68-904a-6bca29f2cfad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "address": "fa:16:3e:b2:f9:97", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa484cc1a-32", "ovs_interfaceid": "a484cc1a-32f1-4e1c-95fd-7f80c428e9f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=a484cc1a-32f1-4e1c-95fd-7f80c428e9f0,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa484cc1a-32') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG os_vif [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=a484cc1a-32f1-4e1c-95fd-7f80c428e9f0,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa484cc1a-32') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa484cc1a-32, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fef6114e-548b-4c61-b545-80ef61397f43) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:23:56 user nova-compute[75285]: INFO os_vif [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:f9:97,bridge_name='br-int',has_traffic_filtering=True,id=a484cc1a-32f1-4e1c-95fd-7f80c428e9f0,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa484cc1a-32')
Nov 10 21:23:56 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Deleting instance files /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad_del
Nov 10 21:23:56 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Deletion of /opt/stack/data/nova/instances/aeb029de-eec7-4b68-904a-6bca29f2cfad_del complete
Nov 10 21:23:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:23:56 user nova-compute[75285]: INFO nova.compute.manager [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 10 21:23:56 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:23:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:23:57 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:23:57 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8025MB free_disk=24.982818603515625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:57 user nova-compute[75285]: INFO nova.compute.manager [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Rescuing
Nov 10 21:23:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "refresh_cache-f7280d37-4576-488e-ab31-45dddecf2f93" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquired lock "refresh_cache-f7280d37-4576-488e-ab31-45dddecf2f93" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.network.neutron [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ef5f5450-aef1-48f8-b2c0-617d4fb1803d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance aeb029de-eec7-4b68-904a-6bca29f2cfad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c7933247-e939-4ede-a431-e91488332000 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance f7280d37-4576-488e-ab31-45dddecf2f93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c9f21f47-2211-4d93-b6e6-7f402ed7bc53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing inventories for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating ProviderTree inventory for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating inventory in ProviderTree for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing aggregate associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, aggregates: None {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing trait associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-5bb68b1a-836b-4829-b425-6be61c27e50d req-78dc0a43-5fa4-42cb-825b-596315bf4f0e service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received event network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5bb68b1a-836b-4829-b425-6be61c27e50d req-78dc0a43-5fa4-42cb-825b-596315bf4f0e service nova] Acquiring lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5bb68b1a-836b-4829-b425-6be61c27e50d req-78dc0a43-5fa4-42cb-825b-596315bf4f0e service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5bb68b1a-836b-4829-b425-6be61c27e50d req-78dc0a43-5fa4-42cb-825b-596315bf4f0e service nova] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-5bb68b1a-836b-4829-b425-6be61c27e50d req-78dc0a43-5fa4-42cb-825b-596315bf4f0e service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] No waiting events found dispatching network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:23:57 user nova-compute[75285]: WARNING nova.compute.manager [req-5bb68b1a-836b-4829-b425-6be61c27e50d req-78dc0a43-5fa4-42cb-825b-596315bf4f0e service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received unexpected event network-vif-plugged-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 for instance with vm_state active and task_state deleting.
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.765s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances with incomplete migration  {{(pid=75285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 21:23:57 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:23:58 user nova-compute[75285]: DEBUG nova.network.neutron [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Updating instance_info_cache with network_info: [{"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:23:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Releasing lock "refresh_cache-f7280d37-4576-488e-ab31-45dddecf2f93" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:23:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:58 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:23:58 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Took 2.00 seconds to deallocate network for instance.
Nov 10 21:23:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-f3c86b36-d0c9-44d5-ba81-9840e8bba7a7 req-eac347c9-129f-4a57-8a24-8adb896f01d3 service nova] [instance: aeb029de-eec7-4b68-904a-6bca29f2cfad] Received event network-vif-deleted-a484cc1a-32f1-4e1c-95fd-7f80c428e9f0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:23:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:23:58 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:23:58 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:23:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:58 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Deleted allocations for instance aeb029de-eec7-4b68-904a-6bca29f2cfad
Nov 10 21:23:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2e0223f7-e29c-4b23-94bf-d287fe9bc3d2 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "aeb029de-eec7-4b68-904a-6bca29f2cfad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.600s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:58 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Instance destroyed successfully.
Nov 10 21:23:58 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Attempting a stable device rescue
Nov 10 21:23:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75285) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 21:23:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Instance directory exists: not creating {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 21:23:59 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Creating image(s)
Nov 10 21:23:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "/opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:23:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "/opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:23:59 user nova-compute[75285]: DEBUG nova.objects.instance [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'trusted_certs' on Instance uuid f7280d37-4576-488e-ab31-45dddecf2f93 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:23:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "43e3e92a5574a5143cd026027f3ac8451c97c801" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:23:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "43e3e92a5574a5143cd026027f3ac8451c97c801" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801.part --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-01f2cb51-6c5d-468c-b9b9-174fafe4e4c0 req-b91be473-177f-4ad8-9e66-e36610d14604 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-vif-unplugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-01f2cb51-6c5d-468c-b9b9-174fafe4e4c0 req-b91be473-177f-4ad8-9e66-e36610d14604 service nova] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-01f2cb51-6c5d-468c-b9b9-174fafe4e4c0 req-b91be473-177f-4ad8-9e66-e36610d14604 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-01f2cb51-6c5d-468c-b9b9-174fafe4e4c0 req-b91be473-177f-4ad8-9e66-e36610d14604 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-01f2cb51-6c5d-468c-b9b9-174fafe4e4c0 req-b91be473-177f-4ad8-9e66-e36610d14604 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] No waiting events found dispatching network-vif-unplugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:24:00 user nova-compute[75285]: WARNING nova.compute.manager [req-01f2cb51-6c5d-468c-b9b9-174fafe4e4c0 req-b91be473-177f-4ad8-9e66-e36610d14604 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received unexpected event network-vif-unplugged-a7af338b-7f5a-4847-9746-a770f1182b11 for instance with vm_state active and task_state rescuing.
Nov 10 21:24:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-01f2cb51-6c5d-468c-b9b9-174fafe4e4c0 req-b91be473-177f-4ad8-9e66-e36610d14604 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-01f2cb51-6c5d-468c-b9b9-174fafe4e4c0 req-b91be473-177f-4ad8-9e66-e36610d14604 service nova] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-01f2cb51-6c5d-468c-b9b9-174fafe4e4c0 req-b91be473-177f-4ad8-9e66-e36610d14604 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-01f2cb51-6c5d-468c-b9b9-174fafe4e4c0 req-b91be473-177f-4ad8-9e66-e36610d14604 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-01f2cb51-6c5d-468c-b9b9-174fafe4e4c0 req-b91be473-177f-4ad8-9e66-e36610d14604 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] No waiting events found dispatching network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:24:00 user nova-compute[75285]: WARNING nova.compute.manager [req-01f2cb51-6c5d-468c-b9b9-174fafe4e4c0 req-b91be473-177f-4ad8-9e66-e36610d14604 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received unexpected event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 for instance with vm_state active and task_state rescuing.
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801.part --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG nova.virt.images [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] f42cd651-5dc6-4bf1-bf60-d53979cd6846 was qcow2, converting to raw {{(pid=75285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801.part /opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801.converted {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-b1c51b23-721d-4d22-866f-0adba9c80034 req-5dc48b25-519c-4eb9-8a85-d915c17a3e11 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Received event network-changed-e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-b1c51b23-721d-4d22-866f-0adba9c80034 req-5dc48b25-519c-4eb9-8a85-d915c17a3e11 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Refreshing instance network info cache due to event network-changed-e8496278-f4d1-49c1-9600-7cb6eb637b2a. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b1c51b23-721d-4d22-866f-0adba9c80034 req-5dc48b25-519c-4eb9-8a85-d915c17a3e11 service nova] Acquiring lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b1c51b23-721d-4d22-866f-0adba9c80034 req-5dc48b25-519c-4eb9-8a85-d915c17a3e11 service nova] Acquired lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG nova.network.neutron [req-b1c51b23-721d-4d22-866f-0adba9c80034 req-5dc48b25-519c-4eb9-8a85-d915c17a3e11 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Refreshing network info cache for port e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:00 user nova-compute[75285]: INFO nova.compute.manager [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Terminating instance
Nov 10 21:24:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801.part /opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801.converted" returned: 0 in 0.589s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801.converted --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-a627f7fd-a983-4e84-9aef-079a3591d0cd req-26a178eb-dc68-4a31-8524-91fe20ac5b0b service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Received event network-vif-unplugged-e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a627f7fd-a983-4e84-9aef-079a3591d0cd req-26a178eb-dc68-4a31-8524-91fe20ac5b0b service nova] Acquiring lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a627f7fd-a983-4e84-9aef-079a3591d0cd req-26a178eb-dc68-4a31-8524-91fe20ac5b0b service nova] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a627f7fd-a983-4e84-9aef-079a3591d0cd req-26a178eb-dc68-4a31-8524-91fe20ac5b0b service nova] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-a627f7fd-a983-4e84-9aef-079a3591d0cd req-26a178eb-dc68-4a31-8524-91fe20ac5b0b service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] No waiting events found dispatching network-vif-unplugged-e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:24:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-a627f7fd-a983-4e84-9aef-079a3591d0cd req-26a178eb-dc68-4a31-8524-91fe20ac5b0b service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Received event network-vif-unplugged-e8496278-f4d1-49c1-9600-7cb6eb637b2a for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "43e3e92a5574a5143cd026027f3ac8451c97c801" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.106s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "43e3e92a5574a5143cd026027f3ac8451c97c801" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "43e3e92a5574a5143cd026027f3ac8451c97c801" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.network.neutron [req-b1c51b23-721d-4d22-866f-0adba9c80034 req-5dc48b25-519c-4eb9-8a85-d915c17a3e11 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Updated VIF entry in instance network info cache for port e8496278-f4d1-49c1-9600-7cb6eb637b2a. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.network.neutron [req-b1c51b23-721d-4d22-866f-0adba9c80034 req-5dc48b25-519c-4eb9-8a85-d915c17a3e11 service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Updating instance_info_cache with network_info: [{"id": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "address": "fa:16:3e:ef:5a:f0", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496278-f4", "ovs_interfaceid": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b1c51b23-721d-4d22-866f-0adba9c80034 req-5dc48b25-519c-4eb9-8a85-d915c17a3e11 service nova] Releasing lock "refresh_cache-ef5f5450-aef1-48f8-b2c0-617d4fb1803d" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801 --force-share --output=json" returned: 0 in 0.178s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801,backing_fmt=raw /opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93/disk.rescue {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Instance destroyed successfully.
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.objects.instance [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lazy-loading 'resources' on Instance uuid ef5f5450-aef1-48f8-b2c0-617d4fb1803d {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801,backing_fmt=raw /opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93/disk.rescue" returned: 0 in 0.067s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "43e3e92a5574a5143cd026027f3ac8451c97c801" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.objects.instance [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'migration_context' on Instance uuid f7280d37-4576-488e-ab31-45dddecf2f93 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-357864862',display_name='tempest-TestVolumeBootPattern-server-357864862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-357864862',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAAoUPxLI+zueb7o2tu1JS76f604TN+uq+pfg2zYS5MbkMZtx1Ub2kBFu6OB71sTNt8tpmOHljKAgKzRpBKVdyr/VTj1zgWyamAFtpMuzpYAL+WhfMApRgNi/CTwdcWlw==',key_name='tempest-TestVolumeBootPattern-2083573923',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:17:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04636b8a9e404d40a3a2bc9f63a4df8c',ramdisk_id='',reservation_id='r-y0nyw4cp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1962512242',owner_user_name='tempest-TestVolumeBootPattern-1962512242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:17:39Z,user_data=None,user_id='e16c471c0875416aa0eb86d89eef3a27',uuid=ef5f5450-aef1-48f8-b2c0-617d4fb1803d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "address": "fa:16:3e:ef:5a:f0", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496278-f4", "ovs_interfaceid": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converting VIF {"id": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "address": "fa:16:3e:ef:5a:f0", "network": {"id": "a228b68c-3b74-4b50-8956-b0484d44bdd0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-794772573-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04636b8a9e404d40a3a2bc9f63a4df8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496278-f4", "ovs_interfaceid": "e8496278-f4d1-49c1-9600-7cb6eb637b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:5a:f0,bridge_name='br-int',has_traffic_filtering=True,id=e8496278-f4d1-49c1-9600-7cb6eb637b2a,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8496278-f4') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_vif [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:5a:f0,bridge_name='br-int',has_traffic_filtering=True,id=e8496278-f4d1-49c1-9600-7cb6eb637b2a,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8496278-f4') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.objects.base [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Object Instance<f7280d37-4576-488e-ab31-45dddecf2f93> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Start _get_guest_xml network_info=[{"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "vif_mac": "fa:16:3e:f9:a0:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f42cd651-5dc6-4bf1-bf60-d53979cd6846', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '6fef6cf8-efe0-4e1d-a305-1ca05c6c8ed5', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqpSXRkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'f7280d37-4576-488e-ab31-45dddecf2f93', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9', 'serial': 'ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.objects.instance [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'resources' on Instance uuid f7280d37-4576-488e-ab31-45dddecf2f93 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8496278-f4, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.objects.base [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Object Instance<f7280d37-4576-488e-ab31-45dddecf2f93> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.objects.instance [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'numa_topology' on Instance uuid f7280d37-4576-488e-ab31-45dddecf2f93 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a854f48-daa6-4eb3-b85c-22ffe0384760) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.objects.base [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Object Instance<f7280d37-4576-488e-ab31-45dddecf2f93> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:01 user nova-compute[75285]: INFO os_vif [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:5a:f0,bridge_name='br-int',has_traffic_filtering=True,id=e8496278-f4d1-49c1-9600-7cb6eb637b2a,network=Network(a228b68c-3b74-4b50-8956-b0484d44bdd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8496278-f4')
Nov 10 21:24:01 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:24:01 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZFsAejg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:24:01 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.objects.instance [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'vcpu_model' on Instance uuid f7280d37-4576-488e-ab31-45dddecf2f93 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffcda50-16b9-49a1-bd13-b3aa9c469449]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:24:01 user nova-compute[75285]: No targets found.
Nov 10 21:24:01 user nova-compute[75285]: iSNS:
Nov 10 21:24:01 user nova-compute[75285]: No targets found.
Nov 10 21:24:01 user nova-compute[75285]: STATIC:
Nov 10 21:24:01 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:24:01 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:24:01 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:24:01 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c
Nov 10 21:24:01 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:24:01 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:24:01 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9
Nov 10 21:24:01 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:24:01 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:24:01 user nova-compute[75285]: FIRMWARE:
Nov 10 21:24:01 user nova-compute[75285]: No targets found.
Nov 10 21:24:01 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:24:01 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:24:01 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.objects.base [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Object Instance<f7280d37-4576-488e-ab31-45dddecf2f93> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqpSXRkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:24:01 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b1e823-4b06-47be-ad7f-3ff445e14beb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8ffb9c-a770-4d31-ab56-0443d64fb434]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:24:01 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:24:01 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:24:01 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:24:01 user nova-compute[75285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c (non-flash)
Nov 10 21:24:01 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:24:01 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e46dc4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c'): ({'sde'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Removing single pathed devices sde {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[465d3d9b-923e-4016-98a1-7456660b2f17]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[880d9539-5930-42b5-a644-16882bc45bd0]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Flushing IO for device /dev/sde {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98da097-4911-494e-a0c4-90f35d66233b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e53a56-72a6-48aa-a345-9ec666f6b224]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] SCSI volumes sde have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_37a009cc', '/dev/disk/by-id/scsi-1SCST_BIO37a009cc-85ceb7a9c5b97da1', '/dev/disk/by-id/scsi-23835636562376139') {{(pid=86427) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8ba446-bd40-42e5-a3e2-86cb400182b7]: (4, None) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dcff34-8385-4d88-a0bc-cd00a409cbd7]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8af80f4-05f5-4662-b16b-92845ba3f1ac]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260]
Nov 10 21:24:01 user nova-compute[75285]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c, portal: 172.16.0.220,3260] successful.
Nov 10 21:24:01 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa895f68-63cb-4dad-aedf-9ac3c418b57c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bef44df-9e97-4be2-884e-bffe15147a80]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] <== disconnect_volume: return (317ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:24:01 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Deleting instance files /opt/stack/data/nova/instances/ef5f5450-aef1-48f8-b2c0-617d4fb1803d_del
Nov 10 21:24:01 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Deletion of /opt/stack/data/nova/instances/ef5f5450-aef1-48f8-b2c0-617d4fb1803d_del complete
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.266s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:24:01 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:24:01 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a241f0-76ac-4c2b-bd5f-bce77d03dbc8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = HqpSXRkB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 21:24:01 user nova-compute[75285]: node.name = iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9
Nov 10 21:24:01 user nova-compute[75285]: node.tpgt = -1
Nov 10 21:24:01 user nova-compute[75285]: node.startup = automatic
Nov 10 21:24:01 user nova-compute[75285]: node.leading_login = No
Nov 10 21:24:01 user nova-compute[75285]: iface.iscsi_ifacename = default
Nov 10 21:24:01 user nova-compute[75285]: iface.net_ifacename = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.ipaddress = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.prefix_len = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.hwaddress = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.transport_name = tcp
Nov 10 21:24:01 user nova-compute[75285]: iface.initiatorname = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.state = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.vlan_id = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.vlan_priority = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.vlan_state = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.iface_num = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.mtu = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.port = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.bootproto = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.subnet_mask = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.gateway = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.dhcp_alt_client_id = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.dhcp_dns = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.dhcp_learn_iqn = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.dhcp_vendor_id_state = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.dhcp_vendor_id = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.dhcp_slp_da = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.fragmentation = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.gratuitous_arp = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.incoming_forwarding = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.tos_state = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.tos = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.ttl = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.delayed_ack = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.tcp_nagle = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.tcp_wsf_state = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.tcp_wsf = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.tcp_timer_scale = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.tcp_timestamp = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.redirect = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.def_task_mgmt_timeout = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.header_digest = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.data_digest = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.immediate_data = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.initial_r2t = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.data_seq_inorder = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.data_pdu_inorder = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.erl = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.max_receive_data_len = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.first_burst_len = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.max_outstanding_r2t = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.max_burst_len = 0
Nov 10 21:24:01 user nova-compute[75285]: iface.chap_auth = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.bidi_chap = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.strict_login_compliance = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.discovery_auth = <empty>
Nov 10 21:24:01 user nova-compute[75285]: iface.discovery_logout = <empty>
Nov 10 21:24:01 user nova-compute[75285]: node.discovery_address = <empty>
Nov 10 21:24:01 user nova-compute[75285]: node.discovery_port = 0
Nov 10 21:24:01 user nova-compute[75285]: node.discovery_type = static
Nov 10 21:24:01 user nova-compute[75285]: node.session.initial_cmdsn = 0
Nov 10 21:24:01 user nova-compute[75285]: node.session.initial_login_retry_max = 8
Nov 10 21:24:01 user nova-compute[75285]: node.session.xmit_thread_priority = -20
Nov 10 21:24:01 user nova-compute[75285]: node.session.cmds_max = 128
Nov 10 21:24:01 user nova-compute[75285]: node.session.queue_depth = 32
Nov 10 21:24:01 user nova-compute[75285]: node.session.nr_sessions = 1
Nov 10 21:24:01 user nova-compute[75285]: node.session.auth.authmethod = CHAP
Nov 10 21:24:01 user nova-compute[75285]: node.session.auth.username = HqpSXRkB
Nov 10 21:24:01 user nova-compute[75285]: node.session.auth.password = ***
Nov 10 21:24:01 user nova-compute[75285]: node.session.auth.username_in = <empty>
Nov 10 21:24:01 user nova-compute[75285]: node.session.auth.password_in = <empty>
Nov 10 21:24:01 user nova-compute[75285]: node.session.auth.chap_algs = MD5
Nov 10 21:24:01 user nova-compute[75285]: node.session.timeo.replacement_timeout = 120
Nov 10 21:24:01 user nova-compute[75285]: node.session.err_timeo.abort_timeout = 15
Nov 10 21:24:01 user nova-compute[75285]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 21:24:01 user nova-compute[75285]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 21:24:01 user nova-compute[75285]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 21:24:01 user nova-compute[75285]: node.session.iscsi.FastAbort = Yes
Nov 10 21:24:01 user nova-compute[75285]: node.session.iscsi.InitialR2T = No
Nov 10 21:24:01 user nova-compute[75285]: node.session.iscsi.ImmediateData = Yes
Nov 10 21:24:01 user nova-compute[75285]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 21:24:01 user nova-compute[75285]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 21:24:01 user nova-compute[75285]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 21:24:01 user nova-compute[75285]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 21:24:01 user nova-compute[75285]: node.session.iscsi.MaxConnections = 1
Nov 10 21:24:01 user nova-compute[75285]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 21:24:01 user nova-compute[75285]: node.session.iscsi.ERL = 0
Nov 10 21:24:01 user nova-compute[75285]: node.session.scan = manual
Nov 10 21:24:01 user nova-compute[75285]: node.session.reopen_max = 0
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].address = 172.16.0.220
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].port = 3260
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].startup = manual
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].tcp.window_size = 524288
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].tcp.type_of_service = 0
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].timeo.logout_timeout = 15
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].timeo.login_timeout = 15
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].timeo.auth_timeout = 45
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].iscsi.DataDigest = None
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].iscsi.IFMarker = No
Nov 10 21:24:01 user nova-compute[75285]: node.conn[0].iscsi.OFMarker = No
Nov 10 21:24:01 user nova-compute[75285]: # END RECORD
Nov 10 21:24:01 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c9daea-f0b6-4ab4-b1da-910219a945bb]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45fc648-d56c-4759-8886-0695a3621739]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqpSXRkB {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: INFO nova.compute.manager [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Took 1.48 seconds to destroy the instance on the hypervisor.
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqpSXRkB" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ccb7aa-13f1-4f7d-819c-40db72fd8862]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HqpSXRkB'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3c4535-988c-41e7-bed8-d3a7f3e0a051]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f82d74-74e0-4414-b1ab-6327d5eea191]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:24:01 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:24:01 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:24:01 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:24:01 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] HCTL ('37', '0', '0', 0) found on session 30 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c8cc0c-4172-4672-a4c7-25870ffaf683]: (4, ('0 0 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Searching for a device in session 30 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqpSXRkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.175s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] <== connect_volume: return (442ms) {'type': 'block', 'scsi_wwn': '23336376261396662', 'path': '/dev/sdf'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336376261396662', 'path': '/dev/sdf'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1144674436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1144674436',id=34,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9957f55c59044088e94338564e04092',ramdisk_id='',reservation_id='r-kaz9xqte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-396261753',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:22:18Z,user_data=None,user_id='ac13c724170f47368e5a395110c631b7',uuid=f7280d37-4576-488e-ab31-45dddecf2f93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "vif_mac": "fa:16:3e:f9:a0:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converting VIF {"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "vif_mac": "fa:16:3e:f9:a0:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:a0:f4,bridge_name='br-int',has_traffic_filtering=True,id=a7af338b-7f5a-4847-9746-a770f1182b11,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7af338b-7f') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.objects.instance [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'pci_devices' on Instance uuid f7280d37-4576-488e-ab31-45dddecf2f93 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:01 user nova-compute[75285]: DEBUG nova.objects.base [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Object Instance<f7280d37-4576-488e-ab31-45dddecf2f93> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:24:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:24:02 user nova-compute[75285]:   <uuid>f7280d37-4576-488e-ab31-45dddecf2f93</uuid>
Nov 10 21:24:02 user nova-compute[75285]:   <name>instance-00000022</name>
Nov 10 21:24:02 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:24:02 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:24:02 user nova-compute[75285]:   <metadata>
Nov 10 21:24:02 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:24:02 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:24:02 user nova-compute[75285]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1144674436</nova:name>
Nov 10 21:24:02 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:24:01</nova:creationTime>
Nov 10 21:24:02 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:24:02 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:24:02 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:24:02 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:24:02 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:24:02 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:24:02 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:24:02 user nova-compute[75285]:       <nova:owner>
Nov 10 21:24:02 user nova-compute[75285]:         <nova:user uuid="ac13c724170f47368e5a395110c631b7">tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member</nova:user>
Nov 10 21:24:02 user nova-compute[75285]:         <nova:project uuid="b9957f55c59044088e94338564e04092">tempest-ServerBootFromVolumeStableRescueTest-396261753</nova:project>
Nov 10 21:24:02 user nova-compute[75285]:       </nova:owner>
Nov 10 21:24:02 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:24:02 user nova-compute[75285]:       <nova:ports>
Nov 10 21:24:02 user nova-compute[75285]:         <nova:port uuid="a7af338b-7f5a-4847-9746-a770f1182b11">
Nov 10 21:24:02 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 21:24:02 user nova-compute[75285]:         </nova:port>
Nov 10 21:24:02 user nova-compute[75285]:       </nova:ports>
Nov 10 21:24:02 user nova-compute[75285]:     </nova:instance>
Nov 10 21:24:02 user nova-compute[75285]:   </metadata>
Nov 10 21:24:02 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:24:02 user nova-compute[75285]:     <system>
Nov 10 21:24:02 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:24:02 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:24:02 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:24:02 user nova-compute[75285]:       <entry name="serial">f7280d37-4576-488e-ab31-45dddecf2f93</entry>
Nov 10 21:24:02 user nova-compute[75285]:       <entry name="uuid">f7280d37-4576-488e-ab31-45dddecf2f93</entry>
Nov 10 21:24:02 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:24:02 user nova-compute[75285]:     </system>
Nov 10 21:24:02 user nova-compute[75285]:   </sysinfo>
Nov 10 21:24:02 user nova-compute[75285]:   <os>
Nov 10 21:24:02 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:24:02 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:24:02 user nova-compute[75285]:   </os>
Nov 10 21:24:02 user nova-compute[75285]:   <features>
Nov 10 21:24:02 user nova-compute[75285]:     <acpi/>
Nov 10 21:24:02 user nova-compute[75285]:     <apic/>
Nov 10 21:24:02 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:24:02 user nova-compute[75285]:   </features>
Nov 10 21:24:02 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:24:02 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:24:02 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:24:02 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:24:02 user nova-compute[75285]:   </clock>
Nov 10 21:24:02 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:24:02 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:24:02 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:24:02 user nova-compute[75285]:   </cpu>
Nov 10 21:24:02 user nova-compute[75285]:   <devices>
Nov 10 21:24:02 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:24:02 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:24:02 user nova-compute[75285]:       <source dev="/dev/sdf"/>
Nov 10 21:24:02 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:24:02 user nova-compute[75285]:       <serial>ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9</serial>
Nov 10 21:24:02 user nova-compute[75285]:     </disk>
Nov 10 21:24:02 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:24:02 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:24:02 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93/disk.rescue"/>
Nov 10 21:24:02 user nova-compute[75285]:       <target dev="vdb" bus="virtio"/>
Nov 10 21:24:02 user nova-compute[75285]:       <boot order="1"/>
Nov 10 21:24:02 user nova-compute[75285]:     </disk>
Nov 10 21:24:02 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:24:02 user nova-compute[75285]:       <mac address="fa:16:3e:f9:a0:f4"/>
Nov 10 21:24:02 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:24:02 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:24:02 user nova-compute[75285]:       <target dev="tapa7af338b-7f"/>
Nov 10 21:24:02 user nova-compute[75285]:     </interface>
Nov 10 21:24:02 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:24:02 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93/console.log" append="off"/>
Nov 10 21:24:02 user nova-compute[75285]:     </serial>
Nov 10 21:24:02 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:24:02 user nova-compute[75285]:     <video>
Nov 10 21:24:02 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:24:02 user nova-compute[75285]:     </video>
Nov 10 21:24:02 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:24:02 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:24:02 user nova-compute[75285]:     </rng>
Nov 10 21:24:02 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:24:02 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:24:02 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:24:02 user nova-compute[75285]:     </memballoon>
Nov 10 21:24:02 user nova-compute[75285]:   </devices>
Nov 10 21:24:02 user nova-compute[75285]: </domain>
Nov 10 21:24:02 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:24:02 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Instance destroyed successfully.
Nov 10 21:24:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:24:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:24:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] No VIF found with MAC fa:16:3e:f9:a0:f4, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:24:02 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:24:02 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Took 0.68 seconds to deallocate network for instance.
Nov 10 21:24:02 user nova-compute[75285]: DEBUG nova.compute.manager [req-f959857e-d777-49fb-a2d4-9ccc1b493a0a req-29594ffa-59f1-41b6-8619-c6985a0c23be service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Received event network-vif-deleted-e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-db135f8c-6f0c-4f82-967a-bc95b5a05b39 req-64cb4203-002b-4425-a537-b003d62f2e3d service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Received event network-vif-plugged-e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-db135f8c-6f0c-4f82-967a-bc95b5a05b39 req-64cb4203-002b-4425-a537-b003d62f2e3d service nova] Acquiring lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-db135f8c-6f0c-4f82-967a-bc95b5a05b39 req-64cb4203-002b-4425-a537-b003d62f2e3d service nova] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-db135f8c-6f0c-4f82-967a-bc95b5a05b39 req-64cb4203-002b-4425-a537-b003d62f2e3d service nova] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-db135f8c-6f0c-4f82-967a-bc95b5a05b39 req-64cb4203-002b-4425-a537-b003d62f2e3d service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] No waiting events found dispatching network-vif-plugged-e8496278-f4d1-49c1-9600-7cb6eb637b2a {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:24:03 user nova-compute[75285]: WARNING nova.compute.manager [req-db135f8c-6f0c-4f82-967a-bc95b5a05b39 req-64cb4203-002b-4425-a537-b003d62f2e3d service nova] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Received unexpected event network-vif-plugged-e8496278-f4d1-49c1-9600-7cb6eb637b2a for instance with vm_state active and task_state deleting.
Nov 10 21:24:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:03 user nova-compute[75285]: INFO nova.compute.manager [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] [instance: ef5f5450-aef1-48f8-b2c0-617d4fb1803d] Took 1.04 seconds to detach 1 volumes for instance.
Nov 10 21:24:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-24752fb7-eb9a-4ce3-be15-4bd414a8307a req-7a593c16-c44d-442d-8f3c-96d135d3ef8f service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-24752fb7-eb9a-4ce3-be15-4bd414a8307a req-7a593c16-c44d-442d-8f3c-96d135d3ef8f service nova] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-24752fb7-eb9a-4ce3-be15-4bd414a8307a req-7a593c16-c44d-442d-8f3c-96d135d3ef8f service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-24752fb7-eb9a-4ce3-be15-4bd414a8307a req-7a593c16-c44d-442d-8f3c-96d135d3ef8f service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-24752fb7-eb9a-4ce3-be15-4bd414a8307a req-7a593c16-c44d-442d-8f3c-96d135d3ef8f service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] No waiting events found dispatching network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:24:03 user nova-compute[75285]: WARNING nova.compute.manager [req-24752fb7-eb9a-4ce3-be15-4bd414a8307a req-7a593c16-c44d-442d-8f3c-96d135d3ef8f service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received unexpected event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 for instance with vm_state active and task_state rescuing.
Nov 10 21:24:03 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:24:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:04 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Deleted allocations for instance ef5f5450-aef1-48f8-b2c0-617d4fb1803d
Nov 10 21:24:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-106c479a-4778-44c7-85d6-a69c9df53d1b tempest-TestVolumeBootPattern-1962512242 tempest-TestVolumeBootPattern-1962512242-project-member] Lock "ef5f5450-aef1-48f8-b2c0-617d4fb1803d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.730s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-824c03ca-c339-4480-a7eb-da860e88016a tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:24:05 user nova-compute[75285]: DEBUG nova.compute.manager [req-46731e4e-a706-4dea-9bbb-c34925009913 req-477acec1-e34f-4353-b430-6b2485395235 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-46731e4e-a706-4dea-9bbb-c34925009913 req-477acec1-e34f-4353-b430-6b2485395235 service nova] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-46731e4e-a706-4dea-9bbb-c34925009913 req-477acec1-e34f-4353-b430-6b2485395235 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-46731e4e-a706-4dea-9bbb-c34925009913 req-477acec1-e34f-4353-b430-6b2485395235 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:05 user nova-compute[75285]: DEBUG nova.compute.manager [req-46731e4e-a706-4dea-9bbb-c34925009913 req-477acec1-e34f-4353-b430-6b2485395235 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] No waiting events found dispatching network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:24:05 user nova-compute[75285]: WARNING nova.compute.manager [req-46731e4e-a706-4dea-9bbb-c34925009913 req-477acec1-e34f-4353-b430-6b2485395235 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received unexpected event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 for instance with vm_state rescued and task_state None.
Nov 10 21:24:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "63869b5c-443c-4bc6-ac63-f3b559290917" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "63869b5c-443c-4bc6-ac63-f3b559290917" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:07 user nova-compute[75285]: INFO nova.compute.manager [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Unshelving
Nov 10 21:24:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:07 user nova-compute[75285]: DEBUG nova.objects.instance [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'pci_requests' on Instance uuid 63869b5c-443c-4bc6-ac63-f3b559290917 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:07 user nova-compute[75285]: DEBUG nova.objects.instance [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'numa_topology' on Instance uuid 63869b5c-443c-4bc6-ac63-f3b559290917 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:08 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:24:08 user nova-compute[75285]: INFO nova.compute.claims [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Claim successful on node user
Nov 10 21:24:08 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:24:08 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:24:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:08 user nova-compute[75285]: INFO nova.network.neutron [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updating port a027d49a-f9ca-43fa-af0c-e62afd4e83dc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquired lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG nova.network.neutron [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-0de691ed-6b86-4d92-9748-34ac99a82d50 req-14308909-1293-4ba9-8fa6-36cd80bf5190 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received event network-changed-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-0de691ed-6b86-4d92-9748-34ac99a82d50 req-14308909-1293-4ba9-8fa6-36cd80bf5190 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Refreshing instance network info cache due to event network-changed-a027d49a-f9ca-43fa-af0c-e62afd4e83dc. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0de691ed-6b86-4d92-9748-34ac99a82d50 req-14308909-1293-4ba9-8fa6-36cd80bf5190 service nova] Acquiring lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG nova.network.neutron [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updating instance_info_cache with network_info: [{"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Releasing lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:24:09 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Creating image(s)
Nov 10 21:24:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "/opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "/opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "/opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG nova.objects.instance [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'trusted_certs' on Instance uuid 63869b5c-443c-4bc6-ac63-f3b559290917 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0de691ed-6b86-4d92-9748-34ac99a82d50 req-14308909-1293-4ba9-8fa6-36cd80bf5190 service nova] Acquired lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG nova.network.neutron [req-0de691ed-6b86-4d92-9748-34ac99a82d50 req-14308909-1293-4ba9-8fa6-36cd80bf5190 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Refreshing network info cache for port a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG nova.objects.base [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Object Instance<63869b5c-443c-4bc6-ac63-f3b559290917> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "8b4c8b4404256667af7cf2a15a410fc347b757ef" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "8b4c8b4404256667af7cf2a15a410fc347b757ef" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef.part --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef.part --force-share --output=json" returned: 0 in 0.223s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG nova.virt.images [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] 257ca9f0-5be9-431f-b7f8-ecb244960f27 was qcow2, converting to raw {{(pid=75285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef.part /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef.converted {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef.part /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef.converted" returned: 0 in 0.199s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef.converted --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "8b4c8b4404256667af7cf2a15a410fc347b757ef" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.735s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG nova.network.neutron [req-0de691ed-6b86-4d92-9748-34ac99a82d50 req-14308909-1293-4ba9-8fa6-36cd80bf5190 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updated VIF entry in instance network info cache for port a027d49a-f9ca-43fa-af0c-e62afd4e83dc. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG nova.network.neutron [req-0de691ed-6b86-4d92-9748-34ac99a82d50 req-14308909-1293-4ba9-8fa6-36cd80bf5190 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updating instance_info_cache with network_info: [{"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0de691ed-6b86-4d92-9748-34ac99a82d50 req-14308909-1293-4ba9-8fa6-36cd80bf5190 service nova] Releasing lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef --force-share --output=json" returned: 0 in 0.214s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "8b4c8b4404256667af7cf2a15a410fc347b757ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "8b4c8b4404256667af7cf2a15a410fc347b757ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef --force-share --output=json" returned: 0 in 0.255s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef,backing_fmt=raw /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef,backing_fmt=raw /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk 1073741824" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "8b4c8b4404256667af7cf2a15a410fc347b757ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.445s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef --force-share --output=json" returned: 0 in 0.224s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:12 user nova-compute[75285]: DEBUG nova.objects.instance [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'migration_context' on Instance uuid 63869b5c-443c-4bc6-ac63-f3b559290917 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:12 user nova-compute[75285]: DEBUG nova.objects.base [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Object Instance<63869b5c-443c-4bc6-ac63-f3b559290917> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:24:12 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Rebasing disk image.
Nov 10 21:24:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.218s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 -F raw /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-d5fc1bdd-1cc6-42e6-9343-9f19f45dbc7a req-e9642a99-9c25-417d-828e-c83173152f76 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Received event network-changed-9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-d5fc1bdd-1cc6-42e6-9343-9f19f45dbc7a req-e9642a99-9c25-417d-828e-c83173152f76 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Refreshing instance network info cache due to event network-changed-9587f821-c03c-4088-803c-0d1b6f4e5560. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:24:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d5fc1bdd-1cc6-42e6-9343-9f19f45dbc7a req-e9642a99-9c25-417d-828e-c83173152f76 service nova] Acquiring lock "refresh_cache-c9f21f47-2211-4d93-b6e6-7f402ed7bc53" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:24:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d5fc1bdd-1cc6-42e6-9343-9f19f45dbc7a req-e9642a99-9c25-417d-828e-c83173152f76 service nova] Acquired lock "refresh_cache-c9f21f47-2211-4d93-b6e6-7f402ed7bc53" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:24:14 user nova-compute[75285]: DEBUG nova.network.neutron [req-d5fc1bdd-1cc6-42e6-9343-9f19f45dbc7a req-e9642a99-9c25-417d-828e-c83173152f76 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Refreshing network info cache for port 9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:24:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:14 user nova-compute[75285]: DEBUG nova.objects.instance [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lazy-loading 'flavor' on Instance uuid c9f21f47-2211-4d93-b6e6-7f402ed7bc53 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:14 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Ignoring supplied device name: /dev/vdb
Nov 10 21:24:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:15 user nova-compute[75285]: INFO nova.compute.manager [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Attaching volume edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d to /dev/vdb
Nov 10 21:24:15 user nova-compute[75285]: DEBUG os_brick.utils [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5860fba-149f-4cb2-917b-d0de9ef742fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[28014c03-09bd-49a0-9f1c-ca75281d4a82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[af29cd33-75b2-4409-9c5d-d432aef24473]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 -F raw /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk" returned: 0 in 2.378s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Ensure instance console log exists: /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Start _get_guest_xml network_info=[{"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='bb33c6407cd9de375f7f856786d6965c',container_format='bare',created_at=2023-11-10T21:22:14Z,direct_url=<?>,disk_format='qcow2',id=257ca9f0-5be9-431f-b7f8-ecb244960f27,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1135169646-shelved',owner='846fec1848ac4cbfa88b60ba0cf98e3c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T21:22:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.network.neutron [req-d5fc1bdd-1cc6-42e6-9343-9f19f45dbc7a req-e9642a99-9c25-417d-828e-c83173152f76 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Updated VIF entry in instance network info cache for port 9587f821-c03c-4088-803c-0d1b6f4e5560. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.network.neutron [req-d5fc1bdd-1cc6-42e6-9343-9f19f45dbc7a req-e9642a99-9c25-417d-828e-c83173152f76 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Updating instance_info_cache with network_info: [{"id": "9587f821-c03c-4088-803c-0d1b6f4e5560", "address": "fa:16:3e:de:96:40", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9587f821-c0", "ovs_interfaceid": "9587f821-c03c-4088-803c-0d1b6f4e5560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[734c8b3b-fd4f-4ba7-b410-ba8152990907]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d5fc1bdd-1cc6-42e6-9343-9f19f45dbc7a req-e9642a99-9c25-417d-828e-c83173152f76 service nova] Releasing lock "refresh_cache-c9f21f47-2211-4d93-b6e6-7f402ed7bc53" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:15 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:24:15 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:24:15 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:24:15 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f655c5a5-7cd4-4ff2-998a-5c3dcdfa06b3]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG os_brick.utils [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Updating existing volume attachment record: ac84cc03-bb9e-4792-9482-cd1168ebfb0b {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bb33c6407cd9de375f7f856786d6965c',container_format='bare',created_at=2023-11-10T21:22:14Z,direct_url=<?>,disk_format='qcow2',id=257ca9f0-5be9-431f-b7f8-ecb244960f27,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1135169646-shelved',owner='846fec1848ac4cbfa88b60ba0cf98e3c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T21:22:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.objects.instance [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'vcpu_model' on Instance uuid 63869b5c-443c-4bc6-ac63-f3b559290917 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.objects.base [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Object Instance<63869b5c-443c-4bc6-ac63-f3b559290917> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T21:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1135169646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1135169646',id=33,image_ref='257ca9f0-5be9-431f-b7f8-ecb244960f27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-153817456',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:20:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='846fec1848ac4cbfa88b60ba0cf98e3c',ramdisk_id='',reservation_id='r-46g8atv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-605808320',owner_user_name='tempest-AttachVolumeShelveTestJSON-605808320-project-member',shelved_at='2023-11-10T21:22:18.982932',shelved_host='user',shelved_image_id='257ca9f0-5be9-431f-b7f8-ecb244960f27'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:24:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51709428ae324620840611f8eb1c216f',uuid=63869b5c-443c-4bc6-ac63-f3b559290917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converting VIF {"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:f9,bridge_name='br-int',has_traffic_filtering=True,id=a027d49a-f9ca-43fa-af0c-e62afd4e83dc,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa027d49a-f9') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.objects.instance [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'pci_devices' on Instance uuid 63869b5c-443c-4bc6-ac63-f3b559290917 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.objects.base [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Object Instance<63869b5c-443c-4bc6-ac63-f3b559290917> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:24:15 user nova-compute[75285]:   <uuid>63869b5c-443c-4bc6-ac63-f3b559290917</uuid>
Nov 10 21:24:15 user nova-compute[75285]:   <name>instance-00000021</name>
Nov 10 21:24:15 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:24:15 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:24:15 user nova-compute[75285]:   <metadata>
Nov 10 21:24:15 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:24:15 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:24:15 user nova-compute[75285]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1135169646</nova:name>
Nov 10 21:24:15 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:24:15</nova:creationTime>
Nov 10 21:24:15 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:24:15 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:24:15 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:24:15 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:24:15 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:24:15 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:24:15 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:24:15 user nova-compute[75285]:       <nova:owner>
Nov 10 21:24:15 user nova-compute[75285]:         <nova:user uuid="51709428ae324620840611f8eb1c216f">tempest-AttachVolumeShelveTestJSON-605808320-project-member</nova:user>
Nov 10 21:24:15 user nova-compute[75285]:         <nova:project uuid="846fec1848ac4cbfa88b60ba0cf98e3c">tempest-AttachVolumeShelveTestJSON-605808320</nova:project>
Nov 10 21:24:15 user nova-compute[75285]:       </nova:owner>
Nov 10 21:24:15 user nova-compute[75285]:       <nova:root type="image" uuid="257ca9f0-5be9-431f-b7f8-ecb244960f27"/>
Nov 10 21:24:15 user nova-compute[75285]:       <nova:ports>
Nov 10 21:24:15 user nova-compute[75285]:         <nova:port uuid="a027d49a-f9ca-43fa-af0c-e62afd4e83dc">
Nov 10 21:24:15 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 21:24:15 user nova-compute[75285]:         </nova:port>
Nov 10 21:24:15 user nova-compute[75285]:       </nova:ports>
Nov 10 21:24:15 user nova-compute[75285]:     </nova:instance>
Nov 10 21:24:15 user nova-compute[75285]:   </metadata>
Nov 10 21:24:15 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:24:15 user nova-compute[75285]:     <system>
Nov 10 21:24:15 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:24:15 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:24:15 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:24:15 user nova-compute[75285]:       <entry name="serial">63869b5c-443c-4bc6-ac63-f3b559290917</entry>
Nov 10 21:24:15 user nova-compute[75285]:       <entry name="uuid">63869b5c-443c-4bc6-ac63-f3b559290917</entry>
Nov 10 21:24:15 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:24:15 user nova-compute[75285]:     </system>
Nov 10 21:24:15 user nova-compute[75285]:   </sysinfo>
Nov 10 21:24:15 user nova-compute[75285]:   <os>
Nov 10 21:24:15 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:24:15 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:24:15 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:24:15 user nova-compute[75285]:   </os>
Nov 10 21:24:15 user nova-compute[75285]:   <features>
Nov 10 21:24:15 user nova-compute[75285]:     <acpi/>
Nov 10 21:24:15 user nova-compute[75285]:     <apic/>
Nov 10 21:24:15 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:24:15 user nova-compute[75285]:   </features>
Nov 10 21:24:15 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:24:15 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:24:15 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:24:15 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:24:15 user nova-compute[75285]:   </clock>
Nov 10 21:24:15 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:24:15 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:24:15 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:24:15 user nova-compute[75285]:   </cpu>
Nov 10 21:24:15 user nova-compute[75285]:   <devices>
Nov 10 21:24:15 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:24:15 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:24:15 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk"/>
Nov 10 21:24:15 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:24:15 user nova-compute[75285]:     </disk>
Nov 10 21:24:15 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:24:15 user nova-compute[75285]:       <mac address="fa:16:3e:ae:2d:f9"/>
Nov 10 21:24:15 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:24:15 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:24:15 user nova-compute[75285]:       <target dev="tapa027d49a-f9"/>
Nov 10 21:24:15 user nova-compute[75285]:     </interface>
Nov 10 21:24:15 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:24:15 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/console.log" append="off"/>
Nov 10 21:24:15 user nova-compute[75285]:     </serial>
Nov 10 21:24:15 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:24:15 user nova-compute[75285]:     <video>
Nov 10 21:24:15 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:24:15 user nova-compute[75285]:     </video>
Nov 10 21:24:15 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:24:15 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:24:15 user nova-compute[75285]:     </rng>
Nov 10 21:24:15 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:24:15 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:24:15 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:24:15 user nova-compute[75285]:     </memballoon>
Nov 10 21:24:15 user nova-compute[75285]:   </devices>
Nov 10 21:24:15 user nova-compute[75285]: </domain>
Nov 10 21:24:15 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T21:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1135169646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1135169646',id=33,image_ref='257ca9f0-5be9-431f-b7f8-ecb244960f27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-153817456',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:20:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='846fec1848ac4cbfa88b60ba0cf98e3c',ramdisk_id='',reservation_id='r-46g8atv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-605808320',owner_user_name='tempest-AttachVolumeShelveTestJSON-605808320-project-member',shelved_at='2023-11-10T21:22:18.982932',shelved_host='user',shelved_image_id='257ca9f0-5be9-431f-b7f8-ecb244960f27'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:24:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51709428ae324620840611f8eb1c216f',uuid=63869b5c-443c-4bc6-ac63-f3b559290917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converting VIF {"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:f9,bridge_name='br-int',has_traffic_filtering=True,id=a027d49a-f9ca-43fa-af0c-e62afd4e83dc,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa027d49a-f9') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG os_vif [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:f9,bridge_name='br-int',has_traffic_filtering=True,id=a027d49a-f9ca-43fa-af0c-e62afd4e83dc,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa027d49a-f9') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34c2bb76-e230-59da-af60-78645fe852b9', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa027d49a-f9, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa027d49a-f9, col_values=(('qos', UUID('50066198-0e44-42cf-86cc-7972f562a9af')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa027d49a-f9, col_values=(('external_ids', {'iface-id': 'a027d49a-f9ca-43fa-af0c-e62afd4e83dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:2d:f9', 'vm-uuid': '63869b5c-443c-4bc6-ac63-f3b559290917'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:15 user nova-compute[75285]: INFO os_vif [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:2d:f9,bridge_name='br-int',has_traffic_filtering=True,id=a027d49a-f9ca-43fa-af0c-e62afd4e83dc,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa027d49a-f9')
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:24:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] No VIF found with MAC fa:16:3e:ae:2d:f9, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:24:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-c458d0e7-c741-4364-81e9-d7d904df0686 req-68ad5943-d62a-4e8a-88ef-adb73d002a74 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received event network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c458d0e7-c741-4364-81e9-d7d904df0686 req-68ad5943-d62a-4e8a-88ef-adb73d002a74 service nova] Acquiring lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c458d0e7-c741-4364-81e9-d7d904df0686 req-68ad5943-d62a-4e8a-88ef-adb73d002a74 service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c458d0e7-c741-4364-81e9-d7d904df0686 req-68ad5943-d62a-4e8a-88ef-adb73d002a74 service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-c458d0e7-c741-4364-81e9-d7d904df0686 req-68ad5943-d62a-4e8a-88ef-adb73d002a74 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] No waiting events found dispatching network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:24:17 user nova-compute[75285]: WARNING nova.compute.manager [req-c458d0e7-c741-4364-81e9-d7d904df0686 req-68ad5943-d62a-4e8a-88ef-adb73d002a74 service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received unexpected event network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 21:24:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:24:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:24:19 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Instance spawned successfully.
Nov 10 21:24:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-3adf3b39-6c9f-46a6-b281-53a0c5221466 req-4b4784d0-e3e8-42d4-8c7a-d7d0b7371b4d service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received event network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3adf3b39-6c9f-46a6-b281-53a0c5221466 req-4b4784d0-e3e8-42d4-8c7a-d7d0b7371b4d service nova] Acquiring lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3adf3b39-6c9f-46a6-b281-53a0c5221466 req-4b4784d0-e3e8-42d4-8c7a-d7d0b7371b4d service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3adf3b39-6c9f-46a6-b281-53a0c5221466 req-4b4784d0-e3e8-42d4-8c7a-d7d0b7371b4d service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-3adf3b39-6c9f-46a6-b281-53a0c5221466 req-4b4784d0-e3e8-42d4-8c7a-d7d0b7371b4d service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] No waiting events found dispatching network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:24:19 user nova-compute[75285]: WARNING nova.compute.manager [req-3adf3b39-6c9f-46a6-b281-53a0c5221466 req-4b4784d0-e3e8-42d4-8c7a-d7d0b7371b4d service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received unexpected event network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 21:24:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:24:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b735aa64-6748-41fc-9b05-be15bd589979 tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "63869b5c-443c-4bc6-ac63-f3b559290917" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.824s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoQnbKxq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:24:41 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:24:41 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:24:41 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d4f42f-47c8-4c70-86bd-6e82f9a795d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:24:41 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0c4e3f-174f-415b-abe3-f369dde8a9ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d] added
Nov 10 21:24:41 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8f90ef-4612-4d48-9ea8-85a6249435a5]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7299732-2404-4b81-b68c-ea9a7537a69d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hoQnbKxq {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hoQnbKxq" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bea358-cde8-4a02-a9d9-a4b2eea0c7dc]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hoQnbKxq'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[559f64e4-beae-4659-acc1-19e5cea8d969]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e68335-879e-440b-aba7-6da5e52fe8d4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:24:41 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:24:41 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:24:41 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:24:41 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac73a41-cb27-43dd-85f5-003834e91bc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d, portal: 172.16.0.220,3260]
Nov 10 21:24:41 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d, portal: 172.16.0.220,3260] successful.
Nov 10 21:24:41 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[818fc006-e542-4d53-bed5-eeebb53719df]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4921b99-69e2-45bc-81b7-658ce859a816]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:24:41 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:24:41 user nova-compute[75285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d (non-flash)
Nov 10 21:24:41 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:24:41 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:24:41 user nova-compute[75285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d (non-flash)
Nov 10 21:24:41 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fabf1ef-4bfb-4be2-a856-f0533aee8b09]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:24:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:42 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:24:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoQnbKxq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:24:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:24:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23264646664356261', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:24:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264646664356261', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:24:42 user nova-compute[75285]: DEBUG nova.objects.instance [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lazy-loading 'flavor' on Instance uuid c9f21f47-2211-4d93-b6e6-7f402ed7bc53 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:24:42 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:24:42 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:24:42 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:24:42 user nova-compute[75285]:   <serial>edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d</serial>
Nov 10 21:24:42 user nova-compute[75285]: </disk>
Nov 10 21:24:42 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:24:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:24:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:24:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] No VIF found with MAC fa:16:3e:de:96:40, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:24:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78b582ce-8a8f-4e02-bb15-952c41bb212b tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.222s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Acquiring lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:24:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:43 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:24:43 user nova-compute[75285]: INFO nova.compute.claims [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Claim successful on node user
Nov 10 21:24:44 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG nova.network.neutron [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:24:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:24:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:24:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Creating image(s)
Nov 10 21:24:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "/opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "/opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG nova.policy [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '213399e8dc434957a267ec1ab7fff6fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e01cccea62542d9b0bf6e47bb59eb92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk 1073741824" returned: 0 in 0.052s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.204s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Cannot resize image /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Ensure instance console log exists: /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:45 user nova-compute[75285]: DEBUG nova.network.neutron [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Successfully created port: 35f00ab1-f7ca-45cc-8a65-abdeb7d64815 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.network.neutron [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Successfully updated port: 35f00ab1-f7ca-45cc-8a65-abdeb7d64815 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Acquiring lock "refresh_cache-6b00716e-35ad-4c99-bfae-ad6ffb82133a" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Acquired lock "refresh_cache-6b00716e-35ad-4c99-bfae-ad6ffb82133a" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.network.neutron [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-b6490075-c2c4-4c6a-8b17-9a507094c299 req-3a73e8e7-2a98-4bc5-b65d-44f9ce01932c service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Received event network-changed-35f00ab1-f7ca-45cc-8a65-abdeb7d64815 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-b6490075-c2c4-4c6a-8b17-9a507094c299 req-3a73e8e7-2a98-4bc5-b65d-44f9ce01932c service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Refreshing instance network info cache due to event network-changed-35f00ab1-f7ca-45cc-8a65-abdeb7d64815. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b6490075-c2c4-4c6a-8b17-9a507094c299 req-3a73e8e7-2a98-4bc5-b65d-44f9ce01932c service nova] Acquiring lock "refresh_cache-6b00716e-35ad-4c99-bfae-ad6ffb82133a" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.network.neutron [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.network.neutron [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Updating instance_info_cache with network_info: [{"id": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "address": "fa:16:3e:8d:ce:c1", "network": {"id": "d42eede6-228b-4c2f-a1d7-1de78215e1c9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "716e3a4182a04b06b7fd231305875438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f00ab1-f7", "ovs_interfaceid": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Releasing lock "refresh_cache-6b00716e-35ad-4c99-bfae-ad6ffb82133a" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.compute.manager [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Instance network_info: |[{"id": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "address": "fa:16:3e:8d:ce:c1", "network": {"id": "d42eede6-228b-4c2f-a1d7-1de78215e1c9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "716e3a4182a04b06b7fd231305875438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f00ab1-f7", "ovs_interfaceid": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b6490075-c2c4-4c6a-8b17-9a507094c299 req-3a73e8e7-2a98-4bc5-b65d-44f9ce01932c service nova] Acquired lock "refresh_cache-6b00716e-35ad-4c99-bfae-ad6ffb82133a" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.network.neutron [req-b6490075-c2c4-4c6a-8b17-9a507094c299 req-3a73e8e7-2a98-4bc5-b65d-44f9ce01932c service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Refreshing network info cache for port 35f00ab1-f7ca-45cc-8a65-abdeb7d64815 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Start _get_guest_xml network_info=[{"id": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "address": "fa:16:3e:8d:ce:c1", "network": {"id": "d42eede6-228b-4c2f-a1d7-1de78215e1c9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "716e3a4182a04b06b7fd231305875438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f00ab1-f7", "ovs_interfaceid": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:24:46 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:24:46 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1033767875',display_name='tempest-VolumesNegativeTest-instance-1033767875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1033767875',id=37,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e01cccea62542d9b0bf6e47bb59eb92',ramdisk_id='',reservation_id='r-j6seu7gq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1630007394',owner_user_name='tempest-VolumesNegativeTest-1630007394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:24:45Z,user_data=None,user_id='213399e8dc434957a267ec1ab7fff6fb',uuid=6b00716e-35ad-4c99-bfae-ad6ffb82133a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "address": "fa:16:3e:8d:ce:c1", "network": {"id": "d42eede6-228b-4c2f-a1d7-1de78215e1c9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "716e3a4182a04b06b7fd231305875438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f00ab1-f7", "ovs_interfaceid": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Converting VIF {"id": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "address": "fa:16:3e:8d:ce:c1", "network": {"id": "d42eede6-228b-4c2f-a1d7-1de78215e1c9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "716e3a4182a04b06b7fd231305875438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f00ab1-f7", "ovs_interfaceid": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ce:c1,bridge_name='br-int',has_traffic_filtering=True,id=35f00ab1-f7ca-45cc-8a65-abdeb7d64815,network=Network(d42eede6-228b-4c2f-a1d7-1de78215e1c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f00ab1-f7') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.objects.instance [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b00716e-35ad-4c99-bfae-ad6ffb82133a {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:24:46 user nova-compute[75285]:   <uuid>6b00716e-35ad-4c99-bfae-ad6ffb82133a</uuid>
Nov 10 21:24:46 user nova-compute[75285]:   <name>instance-00000025</name>
Nov 10 21:24:46 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:24:46 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:24:46 user nova-compute[75285]:   <metadata>
Nov 10 21:24:46 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:24:46 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:24:46 user nova-compute[75285]:       <nova:name>tempest-VolumesNegativeTest-instance-1033767875</nova:name>
Nov 10 21:24:46 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:24:46</nova:creationTime>
Nov 10 21:24:46 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:24:46 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:24:46 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:24:46 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:24:46 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:24:46 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:24:46 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:24:46 user nova-compute[75285]:       <nova:owner>
Nov 10 21:24:46 user nova-compute[75285]:         <nova:user uuid="213399e8dc434957a267ec1ab7fff6fb">tempest-VolumesNegativeTest-1630007394-project-member</nova:user>
Nov 10 21:24:46 user nova-compute[75285]:         <nova:project uuid="7e01cccea62542d9b0bf6e47bb59eb92">tempest-VolumesNegativeTest-1630007394</nova:project>
Nov 10 21:24:46 user nova-compute[75285]:       </nova:owner>
Nov 10 21:24:46 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:24:46 user nova-compute[75285]:       <nova:ports>
Nov 10 21:24:46 user nova-compute[75285]:         <nova:port uuid="35f00ab1-f7ca-45cc-8a65-abdeb7d64815">
Nov 10 21:24:46 user nova-compute[75285]:           <nova:ip type="fixed" address="192.168.233.153" ipVersion="4"/>
Nov 10 21:24:46 user nova-compute[75285]:         </nova:port>
Nov 10 21:24:46 user nova-compute[75285]:       </nova:ports>
Nov 10 21:24:46 user nova-compute[75285]:     </nova:instance>
Nov 10 21:24:46 user nova-compute[75285]:   </metadata>
Nov 10 21:24:46 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:24:46 user nova-compute[75285]:     <system>
Nov 10 21:24:46 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:24:46 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:24:46 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:24:46 user nova-compute[75285]:       <entry name="serial">6b00716e-35ad-4c99-bfae-ad6ffb82133a</entry>
Nov 10 21:24:46 user nova-compute[75285]:       <entry name="uuid">6b00716e-35ad-4c99-bfae-ad6ffb82133a</entry>
Nov 10 21:24:46 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:24:46 user nova-compute[75285]:     </system>
Nov 10 21:24:46 user nova-compute[75285]:   </sysinfo>
Nov 10 21:24:46 user nova-compute[75285]:   <os>
Nov 10 21:24:46 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:24:46 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:24:46 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:24:46 user nova-compute[75285]:   </os>
Nov 10 21:24:46 user nova-compute[75285]:   <features>
Nov 10 21:24:46 user nova-compute[75285]:     <acpi/>
Nov 10 21:24:46 user nova-compute[75285]:     <apic/>
Nov 10 21:24:46 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:24:46 user nova-compute[75285]:   </features>
Nov 10 21:24:46 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:24:46 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:24:46 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:24:46 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:24:46 user nova-compute[75285]:   </clock>
Nov 10 21:24:46 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:24:46 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:24:46 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:24:46 user nova-compute[75285]:   </cpu>
Nov 10 21:24:46 user nova-compute[75285]:   <devices>
Nov 10 21:24:46 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:24:46 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:24:46 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk"/>
Nov 10 21:24:46 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:24:46 user nova-compute[75285]:     </disk>
Nov 10 21:24:46 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:24:46 user nova-compute[75285]:       <mac address="fa:16:3e:8d:ce:c1"/>
Nov 10 21:24:46 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:24:46 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:24:46 user nova-compute[75285]:       <target dev="tap35f00ab1-f7"/>
Nov 10 21:24:46 user nova-compute[75285]:     </interface>
Nov 10 21:24:46 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:24:46 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/console.log" append="off"/>
Nov 10 21:24:46 user nova-compute[75285]:     </serial>
Nov 10 21:24:46 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:24:46 user nova-compute[75285]:     <video>
Nov 10 21:24:46 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:24:46 user nova-compute[75285]:     </video>
Nov 10 21:24:46 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:24:46 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:24:46 user nova-compute[75285]:     </rng>
Nov 10 21:24:46 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:24:46 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:24:46 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:24:46 user nova-compute[75285]:     </memballoon>
Nov 10 21:24:46 user nova-compute[75285]:   </devices>
Nov 10 21:24:46 user nova-compute[75285]: </domain>
Nov 10 21:24:46 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1033767875',display_name='tempest-VolumesNegativeTest-instance-1033767875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1033767875',id=37,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e01cccea62542d9b0bf6e47bb59eb92',ramdisk_id='',reservation_id='r-j6seu7gq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1630007394',owner_user_name='tempest-VolumesNegativeTest-1630007394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:24:45Z,user_data=None,user_id='213399e8dc434957a267ec1ab7fff6fb',uuid=6b00716e-35ad-4c99-bfae-ad6ffb82133a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "address": "fa:16:3e:8d:ce:c1", "network": {"id": "d42eede6-228b-4c2f-a1d7-1de78215e1c9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "716e3a4182a04b06b7fd231305875438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f00ab1-f7", "ovs_interfaceid": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Converting VIF {"id": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "address": "fa:16:3e:8d:ce:c1", "network": {"id": "d42eede6-228b-4c2f-a1d7-1de78215e1c9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "716e3a4182a04b06b7fd231305875438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f00ab1-f7", "ovs_interfaceid": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ce:c1,bridge_name='br-int',has_traffic_filtering=True,id=35f00ab1-f7ca-45cc-8a65-abdeb7d64815,network=Network(d42eede6-228b-4c2f-a1d7-1de78215e1c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f00ab1-f7') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG os_vif [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ce:c1,bridge_name='br-int',has_traffic_filtering=True,id=35f00ab1-f7ca-45cc-8a65-abdeb7d64815,network=Network(d42eede6-228b-4c2f-a1d7-1de78215e1c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f00ab1-f7') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ab851c8-9d5e-56a4-a4c1-e0389cad3b22', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35f00ab1-f7, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35f00ab1-f7, col_values=(('qos', UUID('6d57e61c-18ec-4fa2-89d1-d47d14e9412f')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35f00ab1-f7, col_values=(('external_ids', {'iface-id': '35f00ab1-f7ca-45cc-8a65-abdeb7d64815', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:ce:c1', 'vm-uuid': '6b00716e-35ad-4c99-bfae-ad6ffb82133a'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:46 user nova-compute[75285]: INFO os_vif [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ce:c1,bridge_name='br-int',has_traffic_filtering=True,id=35f00ab1-f7ca-45cc-8a65-abdeb7d64815,network=Network(d42eede6-228b-4c2f-a1d7-1de78215e1c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f00ab1-f7')
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:24:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] No VIF found with MAC fa:16:3e:8d:ce:c1, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:24:47 user nova-compute[75285]: DEBUG nova.network.neutron [req-b6490075-c2c4-4c6a-8b17-9a507094c299 req-3a73e8e7-2a98-4bc5-b65d-44f9ce01932c service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Updated VIF entry in instance network info cache for port 35f00ab1-f7ca-45cc-8a65-abdeb7d64815. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:24:47 user nova-compute[75285]: DEBUG nova.network.neutron [req-b6490075-c2c4-4c6a-8b17-9a507094c299 req-3a73e8e7-2a98-4bc5-b65d-44f9ce01932c service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Updating instance_info_cache with network_info: [{"id": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "address": "fa:16:3e:8d:ce:c1", "network": {"id": "d42eede6-228b-4c2f-a1d7-1de78215e1c9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "716e3a4182a04b06b7fd231305875438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f00ab1-f7", "ovs_interfaceid": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:24:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b6490075-c2c4-4c6a-8b17-9a507094c299 req-3a73e8e7-2a98-4bc5-b65d-44f9ce01932c service nova] Releasing lock "refresh_cache-6b00716e-35ad-4c99-bfae-ad6ffb82133a" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:24:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:48 user nova-compute[75285]: DEBUG nova.compute.manager [req-9ca1914f-4204-4555-ae33-7935d2d77f4e req-4612d894-f89f-4b73-857c-0e5b1db97562 service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Received event network-vif-plugged-35f00ab1-f7ca-45cc-8a65-abdeb7d64815 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9ca1914f-4204-4555-ae33-7935d2d77f4e req-4612d894-f89f-4b73-857c-0e5b1db97562 service nova] Acquiring lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9ca1914f-4204-4555-ae33-7935d2d77f4e req-4612d894-f89f-4b73-857c-0e5b1db97562 service nova] Lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9ca1914f-4204-4555-ae33-7935d2d77f4e req-4612d894-f89f-4b73-857c-0e5b1db97562 service nova] Lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:48 user nova-compute[75285]: DEBUG nova.compute.manager [req-9ca1914f-4204-4555-ae33-7935d2d77f4e req-4612d894-f89f-4b73-857c-0e5b1db97562 service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] No waiting events found dispatching network-vif-plugged-35f00ab1-f7ca-45cc-8a65-abdeb7d64815 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:24:48 user nova-compute[75285]: WARNING nova.compute.manager [req-9ca1914f-4204-4555-ae33-7935d2d77f4e req-4612d894-f89f-4b73-857c-0e5b1db97562 service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Received unexpected event network-vif-plugged-35f00ab1-f7ca-45cc-8a65-abdeb7d64815 for instance with vm_state building and task_state spawning.
Nov 10 21:24:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:49 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:24:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:24:50 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:24:50 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Instance spawned successfully.
Nov 10 21:24:50 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:24:50 user nova-compute[75285]: DEBUG nova.compute.manager [req-936fdd54-9b21-46b2-a70c-698f40e78352 req-7f214a4e-bd52-4473-82c1-f49a77affc7e service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Received event network-vif-plugged-35f00ab1-f7ca-45cc-8a65-abdeb7d64815 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:24:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-936fdd54-9b21-46b2-a70c-698f40e78352 req-7f214a4e-bd52-4473-82c1-f49a77affc7e service nova] Acquiring lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-936fdd54-9b21-46b2-a70c-698f40e78352 req-7f214a4e-bd52-4473-82c1-f49a77affc7e service nova] Lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-936fdd54-9b21-46b2-a70c-698f40e78352 req-7f214a4e-bd52-4473-82c1-f49a77affc7e service nova] Lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:50 user nova-compute[75285]: DEBUG nova.compute.manager [req-936fdd54-9b21-46b2-a70c-698f40e78352 req-7f214a4e-bd52-4473-82c1-f49a77affc7e service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] No waiting events found dispatching network-vif-plugged-35f00ab1-f7ca-45cc-8a65-abdeb7d64815 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:24:50 user nova-compute[75285]: WARNING nova.compute.manager [req-936fdd54-9b21-46b2-a70c-698f40e78352 req-7f214a4e-bd52-4473-82c1-f49a77affc7e service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Received unexpected event network-vif-plugged-35f00ab1-f7ca-45cc-8a65-abdeb7d64815 for instance with vm_state building and task_state spawning.
Nov 10 21:24:50 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:24:50 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:24:50 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:24:50 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:24:50 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:24:50 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:24:50 user nova-compute[75285]: INFO nova.compute.manager [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 10 21:24:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:24:50 user nova-compute[75285]: INFO nova.compute.manager [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Took 6.83 seconds to build instance.
Nov 10 21:24:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-938d3193-e3b9-40be-ba3b-8c6d82778a5b tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.947s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:51 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:24:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:24:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:24:54 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:24:54 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:24:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-c7933247-e939-4ede-a431-e91488332000" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:24:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-c7933247-e939-4ede-a431-e91488332000" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:24:54 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c7933247-e939-4ede-a431-e91488332000] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:24:55 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c7933247-e939-4ede-a431-e91488332000] Updating instance_info_cache with network_info: [{"id": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "address": "fa:16:3e:5e:ca:1a", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3d9d05-a6", "ovs_interfaceid": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:24:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-c7933247-e939-4ede-a431-e91488332000" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:24:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c7933247-e939-4ede-a431-e91488332000] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:24:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:24:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:24:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:24:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:24:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:24:55 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:24:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:24:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:56 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:24:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93/disk.rescue --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:24:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:24:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:24:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:24:58 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:24:58 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:24:58 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8034MB free_disk=24.876209259033203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:24:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:24:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:24:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:24:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:24:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:24:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c7933247-e939-4ede-a431-e91488332000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:24:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance f7280d37-4576-488e-ab31-45dddecf2f93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:24:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c9f21f47-2211-4d93-b6e6-7f402ed7bc53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:24:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 63869b5c-443c-4bc6-ac63-f3b559290917 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:24:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 6b00716e-35ad-4c99-bfae-ad6ffb82133a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:24:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:24:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:24:59 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:24:59 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:24:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:24:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:25:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:25:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:25:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:25:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:25:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:25:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:25:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:25:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:25:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:25:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:25:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:25:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:25:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:25:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:48 user nova-compute[75285]: INFO nova.compute.manager [None req-c73c8926-946d-45c9-8504-0b99688da835 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Unrescuing
Nov 10 21:25:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c73c8926-946d-45c9-8504-0b99688da835 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "refresh_cache-f7280d37-4576-488e-ab31-45dddecf2f93" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:25:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c73c8926-946d-45c9-8504-0b99688da835 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquired lock "refresh_cache-f7280d37-4576-488e-ab31-45dddecf2f93" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:25:48 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c73c8926-946d-45c9-8504-0b99688da835 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:25:48 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c73c8926-946d-45c9-8504-0b99688da835 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Updating instance_info_cache with network_info: [{"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:25:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c73c8926-946d-45c9-8504-0b99688da835 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Releasing lock "refresh_cache-f7280d37-4576-488e-ab31-45dddecf2f93" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:25:48 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c73c8926-946d-45c9-8504-0b99688da835 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'flavor' on Instance uuid f7280d37-4576-488e-ab31-45dddecf2f93 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:25:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:49 user nova-compute[75285]: DEBUG nova.compute.manager [req-4d8c5eed-19dd-4964-a48e-3ff7cd07f12b req-dcbdbfe6-074b-426c-abe5-4e41186a10a9 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-vif-unplugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:25:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4d8c5eed-19dd-4964-a48e-3ff7cd07f12b req-dcbdbfe6-074b-426c-abe5-4e41186a10a9 service nova] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:25:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4d8c5eed-19dd-4964-a48e-3ff7cd07f12b req-dcbdbfe6-074b-426c-abe5-4e41186a10a9 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:25:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4d8c5eed-19dd-4964-a48e-3ff7cd07f12b req-dcbdbfe6-074b-426c-abe5-4e41186a10a9 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:25:49 user nova-compute[75285]: DEBUG nova.compute.manager [req-4d8c5eed-19dd-4964-a48e-3ff7cd07f12b req-dcbdbfe6-074b-426c-abe5-4e41186a10a9 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] No waiting events found dispatching network-vif-unplugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:25:49 user nova-compute[75285]: WARNING nova.compute.manager [req-4d8c5eed-19dd-4964-a48e-3ff7cd07f12b req-dcbdbfe6-074b-426c-abe5-4e41186a10a9 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received unexpected event network-vif-unplugged-a7af338b-7f5a-4847-9746-a770f1182b11 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:25:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:49 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Instance destroyed successfully.
Nov 10 21:25:50 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:25:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:51 user nova-compute[75285]: DEBUG nova.compute.manager [req-ced24b9c-c1d4-4aa7-8d03-4b52f25463da req-d0d1b39e-6aad-46c9-bb61-48b0f2225d95 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:25:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ced24b9c-c1d4-4aa7-8d03-4b52f25463da req-d0d1b39e-6aad-46c9-bb61-48b0f2225d95 service nova] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:25:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ced24b9c-c1d4-4aa7-8d03-4b52f25463da req-d0d1b39e-6aad-46c9-bb61-48b0f2225d95 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:25:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ced24b9c-c1d4-4aa7-8d03-4b52f25463da req-d0d1b39e-6aad-46c9-bb61-48b0f2225d95 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:25:51 user nova-compute[75285]: DEBUG nova.compute.manager [req-ced24b9c-c1d4-4aa7-8d03-4b52f25463da req-d0d1b39e-6aad-46c9-bb61-48b0f2225d95 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] No waiting events found dispatching network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:25:51 user nova-compute[75285]: WARNING nova.compute.manager [req-ced24b9c-c1d4-4aa7-8d03-4b52f25463da req-d0d1b39e-6aad-46c9-bb61-48b0f2225d95 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received unexpected event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:25:51 user nova-compute[75285]: DEBUG nova.compute.manager [req-ced24b9c-c1d4-4aa7-8d03-4b52f25463da req-d0d1b39e-6aad-46c9-bb61-48b0f2225d95 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:25:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ced24b9c-c1d4-4aa7-8d03-4b52f25463da req-d0d1b39e-6aad-46c9-bb61-48b0f2225d95 service nova] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:25:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ced24b9c-c1d4-4aa7-8d03-4b52f25463da req-d0d1b39e-6aad-46c9-bb61-48b0f2225d95 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:25:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ced24b9c-c1d4-4aa7-8d03-4b52f25463da req-d0d1b39e-6aad-46c9-bb61-48b0f2225d95 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:25:51 user nova-compute[75285]: DEBUG nova.compute.manager [req-ced24b9c-c1d4-4aa7-8d03-4b52f25463da req-d0d1b39e-6aad-46c9-bb61-48b0f2225d95 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] No waiting events found dispatching network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:25:51 user nova-compute[75285]: WARNING nova.compute.manager [req-ced24b9c-c1d4-4aa7-8d03-4b52f25463da req-d0d1b39e-6aad-46c9-bb61-48b0f2225d95 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received unexpected event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:25:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:52 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:25:53 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c73c8926-946d-45c9-8504-0b99688da835 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:25:53 user nova-compute[75285]: DEBUG nova.compute.manager [req-538a9dfd-ad35-4f77-9bed-efe414fe06f6 req-3554d1e6-cdb7-4654-9831-911bdd8f0a61 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:25:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-538a9dfd-ad35-4f77-9bed-efe414fe06f6 req-3554d1e6-cdb7-4654-9831-911bdd8f0a61 service nova] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:25:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-538a9dfd-ad35-4f77-9bed-efe414fe06f6 req-3554d1e6-cdb7-4654-9831-911bdd8f0a61 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:25:53 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-538a9dfd-ad35-4f77-9bed-efe414fe06f6 req-3554d1e6-cdb7-4654-9831-911bdd8f0a61 service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:25:53 user nova-compute[75285]: DEBUG nova.compute.manager [req-538a9dfd-ad35-4f77-9bed-efe414fe06f6 req-3554d1e6-cdb7-4654-9831-911bdd8f0a61 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] No waiting events found dispatching network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:25:53 user nova-compute[75285]: WARNING nova.compute.manager [req-538a9dfd-ad35-4f77-9bed-efe414fe06f6 req-3554d1e6-cdb7-4654-9831-911bdd8f0a61 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received unexpected event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 for instance with vm_state rescued and task_state unrescuing.
Nov 10 21:25:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:25:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:25:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:25:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:25:55 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:25:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updating instance_info_cache with network_info: [{"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:25:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-63869b5c-443c-4bc6-ac63-f3b559290917" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:25:56 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:25:56 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:25:56 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:25:56 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:25:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:57 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:25:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:25:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:25:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:25:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:25:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "63869b5c-443c-4bc6-ac63-f3b559290917" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "63869b5c-443c-4bc6-ac63-f3b559290917" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:25:58 user nova-compute[75285]: INFO nova.compute.manager [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Terminating instance
Nov 10 21:25:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-e5777dd0-57b4-47e0-b5f4-63cef50ec955 req-6d60beb1-8d8e-470a-afa3-46cd7ae31b6b service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received event network-vif-unplugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e5777dd0-57b4-47e0-b5f4-63cef50ec955 req-6d60beb1-8d8e-470a-afa3-46cd7ae31b6b service nova] Acquiring lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e5777dd0-57b4-47e0-b5f4-63cef50ec955 req-6d60beb1-8d8e-470a-afa3-46cd7ae31b6b service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e5777dd0-57b4-47e0-b5f4-63cef50ec955 req-6d60beb1-8d8e-470a-afa3-46cd7ae31b6b service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-e5777dd0-57b4-47e0-b5f4-63cef50ec955 req-6d60beb1-8d8e-470a-afa3-46cd7ae31b6b service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] No waiting events found dispatching network-vif-unplugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG nova.compute.manager [req-e5777dd0-57b4-47e0-b5f4-63cef50ec955 req-6d60beb1-8d8e-470a-afa3-46cd7ae31b6b service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received event network-vif-unplugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:25:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:25:59 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Instance destroyed successfully.
Nov 10 21:25:59 user nova-compute[75285]: DEBUG nova.objects.instance [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lazy-loading 'resources' on Instance uuid 63869b5c-443c-4bc6-ac63-f3b559290917 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T21:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1135169646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1135169646',id=33,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOTmSqMrfpP4ULBanEmWMIdP/tUpnj4KxwB/AchH+gg4U4S6VjblHfoc+guFOqXeQ9rQFe188DGGYwHi79Xd8dRCfeGh48ucZKaIkvMUU+jkvwLrmTx5ZXfkMjaKFtu2A==',key_name='tempest-keypair-153817456',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:24:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846fec1848ac4cbfa88b60ba0cf98e3c',ramdisk_id='',reservation_id='r-46g8atv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-605808320',owner_user_name='tempest-AttachVolumeShelveTestJSON-605808320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:24:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51709428ae324620840611f8eb1c216f',uuid=63869b5c-443c-4bc6-ac63-f3b559290917,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converting VIF {"id": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "address": "fa:16:3e:ae:2d:f9", "network": {"id": "6de9f562-79aa-4d2d-bd34-ad865ae008ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2132886568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846fec1848ac4cbfa88b60ba0cf98e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa027d49a-f9", "ovs_interfaceid": "a027d49a-f9ca-43fa-af0c-e62afd4e83dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:2d:f9,bridge_name='br-int',has_traffic_filtering=True,id=a027d49a-f9ca-43fa-af0c-e62afd4e83dc,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa027d49a-f9') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG os_vif [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:2d:f9,bridge_name='br-int',has_traffic_filtering=True,id=a027d49a-f9ca-43fa-af0c-e62afd4e83dc,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa027d49a-f9') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa027d49a-f9, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50066198-0e44-42cf-86cc-7972f562a9af) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:25:59 user nova-compute[75285]: INFO os_vif [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:2d:f9,bridge_name='br-int',has_traffic_filtering=True,id=a027d49a-f9ca-43fa-af0c-e62afd4e83dc,network=Network(6de9f562-79aa-4d2d-bd34-ad865ae008ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa027d49a-f9')
Nov 10 21:25:59 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Deleting instance files /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917_del
Nov 10 21:25:59 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Deletion of /opt/stack/data/nova/instances/63869b5c-443c-4bc6-ac63-f3b559290917_del complete
Nov 10 21:25:59 user nova-compute[75285]: INFO nova.compute.manager [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 10 21:25:59 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:25:59 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Error from libvirt while getting description of instance-00000021: [Error Code 42] Domain not found: no domain with matching uuid '63869b5c-443c-4bc6-ac63-f3b559290917' (instance-00000021): libvirt.libvirtError: Domain not found: no domain with matching uuid '63869b5c-443c-4bc6-ac63-f3b559290917' (instance-00000021)
Nov 10 21:25:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:25:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:00 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:26:00 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Took 0.86 seconds to deallocate network for instance.
Nov 10 21:26:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:26:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:00 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:26:00 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:26:00 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8084MB free_disk=23.84567642211914GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:26:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-6304decc-cddc-4e14-ad40-985444c0021b req-8e969e1d-8ea7-4f05-a87e-cc39c497b82c service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received event network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:26:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6304decc-cddc-4e14-ad40-985444c0021b req-8e969e1d-8ea7-4f05-a87e-cc39c497b82c service nova] Acquiring lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6304decc-cddc-4e14-ad40-985444c0021b req-8e969e1d-8ea7-4f05-a87e-cc39c497b82c service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6304decc-cddc-4e14-ad40-985444c0021b req-8e969e1d-8ea7-4f05-a87e-cc39c497b82c service nova] Lock "63869b5c-443c-4bc6-ac63-f3b559290917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-6304decc-cddc-4e14-ad40-985444c0021b req-8e969e1d-8ea7-4f05-a87e-cc39c497b82c service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] No waiting events found dispatching network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:26:00 user nova-compute[75285]: WARNING nova.compute.manager [req-6304decc-cddc-4e14-ad40-985444c0021b req-8e969e1d-8ea7-4f05-a87e-cc39c497b82c service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received unexpected event network-vif-plugged-a027d49a-f9ca-43fa-af0c-e62afd4e83dc for instance with vm_state deleted and task_state None.
Nov 10 21:26:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-6304decc-cddc-4e14-ad40-985444c0021b req-8e969e1d-8ea7-4f05-a87e-cc39c497b82c service nova] [instance: 63869b5c-443c-4bc6-ac63-f3b559290917] Received event network-vif-deleted-a027d49a-f9ca-43fa-af0c-e62afd4e83dc {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:26:00 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:26:00 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:26:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.311s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:00 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Deleted allocations for instance 63869b5c-443c-4bc6-ac63-f3b559290917
Nov 10 21:26:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:26:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:26:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:26:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c7933247-e939-4ede-a431-e91488332000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:26:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance f7280d37-4576-488e-ab31-45dddecf2f93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:26:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c9f21f47-2211-4d93-b6e6-7f402ed7bc53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:26:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 6b00716e-35ad-4c99-bfae-ad6ffb82133a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:26:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:26:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:26:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7ebf9999-99e3-4fcb-8e58-fb5c5bc23d4e tempest-AttachVolumeShelveTestJSON-605808320 tempest-AttachVolumeShelveTestJSON-605808320-project-member] Lock "63869b5c-443c-4bc6-ac63-f3b559290917" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.864s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:01 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:26:01 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:26:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:26:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:26:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:26:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:26:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "bedaaab9-85ae-4a82-86ee-77b70f255a29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:26:08 user nova-compute[75285]: INFO nova.compute.claims [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Claim successful on node user
Nov 10 21:26:08 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG nova.network.neutron [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:26:08 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:26:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG nova.policy [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '187d346b3e1b453e8404662727b21a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e582cea01cf0449fad27fafe0f2d0b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:26:08 user nova-compute[75285]: INFO nova.virt.block_device [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Booting with volume e9d40532-507f-473c-b19f-bbe00cf0bb2c at /dev/vda
Nov 10 21:26:08 user nova-compute[75285]: DEBUG os_brick.utils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf397244-7310-4ba5-8271-07944c4329b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[af55a47c-172e-4a5d-a1e9-d10b9fb250ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b53b7a-4f86-4241-84b8-e0f6dbaa2724]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9527c566-3a01-4f24-a2ef-58d8c1c77a78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:26:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:26:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:26:09 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:26:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[092c1501-6259-478d-acd6-1e6e18f45475]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:26:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:26:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:26:09 user nova-compute[75285]: DEBUG os_brick.utils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:26:09 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updating existing volume attachment record: 025373af-7342-41cb-8580-15e6c8cd139f {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:26:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:09 user nova-compute[75285]: DEBUG nova.network.neutron [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Successfully created port: 70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:26:10 user nova-compute[75285]: DEBUG nova.network.neutron [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Successfully updated port: 70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:26:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:26:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquired lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:26:10 user nova-compute[75285]: DEBUG nova.network.neutron [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:26:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-d690608a-0427-40e5-ac99-4af38c195147 req-c8939919-eb51-4a92-90a4-275b9555b668 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received event network-changed-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:26:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-d690608a-0427-40e5-ac99-4af38c195147 req-c8939919-eb51-4a92-90a4-275b9555b668 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Refreshing instance network info cache due to event network-changed-70a42471-c66d-4646-83d8-478087cf397f. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:26:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d690608a-0427-40e5-ac99-4af38c195147 req-c8939919-eb51-4a92-90a4-275b9555b668 service nova] Acquiring lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:26:10 user nova-compute[75285]: DEBUG nova.network.neutron [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:26:10 user nova-compute[75285]: DEBUG nova.network.neutron [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updating instance_info_cache with network_info: [{"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:26:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Releasing lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:26:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Instance network_info: |[{"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:26:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d690608a-0427-40e5-ac99-4af38c195147 req-c8939919-eb51-4a92-90a4-275b9555b668 service nova] Acquired lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:26:10 user nova-compute[75285]: DEBUG nova.network.neutron [req-d690608a-0427-40e5-ac99-4af38c195147 req-c8939919-eb51-4a92-90a4-275b9555b668 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Refreshing network info cache for port 70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:26:11 user nova-compute[75285]: DEBUG nova.network.neutron [req-d690608a-0427-40e5-ac99-4af38c195147 req-c8939919-eb51-4a92-90a4-275b9555b668 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updated VIF entry in instance network info cache for port 70a42471-c66d-4646-83d8-478087cf397f. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:26:11 user nova-compute[75285]: DEBUG nova.network.neutron [req-d690608a-0427-40e5-ac99-4af38c195147 req-c8939919-eb51-4a92-90a4-275b9555b668 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updating instance_info_cache with network_info: [{"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:26:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d690608a-0427-40e5-ac99-4af38c195147 req-c8939919-eb51-4a92-90a4-275b9555b668 service nova] Releasing lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:26:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:14 user nova-compute[75285]: INFO nova.compute.manager [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Detaching volume edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d
Nov 10 21:26:14 user nova-compute[75285]: INFO nova.virt.block_device [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Attempting to driver detach volume edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d from mountpoint /dev/vdb
Nov 10 21:26:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Attempting to detach device vdb from instance c9f21f47-2211-4d93-b6e6-7f402ed7bc53 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:26:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:26:14 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:26:14 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:26:14 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:26:14 user nova-compute[75285]:   <serial>edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d</serial>
Nov 10 21:26:14 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:26:14 user nova-compute[75285]: </disk>
Nov 10 21:26:14 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:26:14 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Successfully detached device vdb from instance c9f21f47-2211-4d93-b6e6-7f402ed7bc53 from the persistent domain config.
Nov 10 21:26:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9f21f47-2211-4d93-b6e6-7f402ed7bc53 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:26:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:26:14 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:26:14 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:26:14 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:26:14 user nova-compute[75285]:   <serial>edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d</serial>
Nov 10 21:26:14 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:26:14 user nova-compute[75285]: </disk>
Nov 10 21:26:14 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:26:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9f21f47-2211-4d93-b6e6-7f402ed7bc53 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:26:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Acquiring lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Acquiring lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:33 user nova-compute[75285]: INFO nova.compute.manager [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Terminating instance
Nov 10 21:26:33 user nova-compute[75285]: DEBUG nova.compute.manager [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:26:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Instance destroyed successfully.
Nov 10 21:26:34 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lazy-loading 'resources' on Instance uuid 6b00716e-35ad-4c99-bfae-ad6ffb82133a {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:24:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1033767875',display_name='tempest-VolumesNegativeTest-instance-1033767875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1033767875',id=37,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:24:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e01cccea62542d9b0bf6e47bb59eb92',ramdisk_id='',reservation_id='r-j6seu7gq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1630007394',owner_user_name='tempest-VolumesNegativeTest-1630007394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:24:51Z,user_data=None,user_id='213399e8dc434957a267ec1ab7fff6fb',uuid=6b00716e-35ad-4c99-bfae-ad6ffb82133a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "address": "fa:16:3e:8d:ce:c1", "network": {"id": "d42eede6-228b-4c2f-a1d7-1de78215e1c9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "716e3a4182a04b06b7fd231305875438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f00ab1-f7", "ovs_interfaceid": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Converting VIF {"id": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "address": "fa:16:3e:8d:ce:c1", "network": {"id": "d42eede6-228b-4c2f-a1d7-1de78215e1c9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "716e3a4182a04b06b7fd231305875438", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35f00ab1-f7", "ovs_interfaceid": "35f00ab1-f7ca-45cc-8a65-abdeb7d64815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ce:c1,bridge_name='br-int',has_traffic_filtering=True,id=35f00ab1-f7ca-45cc-8a65-abdeb7d64815,network=Network(d42eede6-228b-4c2f-a1d7-1de78215e1c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f00ab1-f7') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG os_vif [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ce:c1,bridge_name='br-int',has_traffic_filtering=True,id=35f00ab1-f7ca-45cc-8a65-abdeb7d64815,network=Network(d42eede6-228b-4c2f-a1d7-1de78215e1c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f00ab1-f7') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35f00ab1-f7, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d57e61c-18ec-4fa2-89d1-d47d14e9412f) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:34 user nova-compute[75285]: INFO os_vif [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:ce:c1,bridge_name='br-int',has_traffic_filtering=True,id=35f00ab1-f7ca-45cc-8a65-abdeb7d64815,network=Network(d42eede6-228b-4c2f-a1d7-1de78215e1c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35f00ab1-f7')
Nov 10 21:26:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Deleting instance files /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a_del
Nov 10 21:26:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Deletion of /opt/stack/data/nova/instances/6b00716e-35ad-4c99-bfae-ad6ffb82133a_del complete
Nov 10 21:26:34 user nova-compute[75285]: INFO nova.compute.manager [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 10 21:26:34 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-74c20305-1541-4885-8c82-c43a1f6baaa0 req-1b02ce77-cb2e-4c00-b887-03711892b122 service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Received event network-vif-unplugged-35f00ab1-f7ca-45cc-8a65-abdeb7d64815 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-74c20305-1541-4885-8c82-c43a1f6baaa0 req-1b02ce77-cb2e-4c00-b887-03711892b122 service nova] Acquiring lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-74c20305-1541-4885-8c82-c43a1f6baaa0 req-1b02ce77-cb2e-4c00-b887-03711892b122 service nova] Lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-74c20305-1541-4885-8c82-c43a1f6baaa0 req-1b02ce77-cb2e-4c00-b887-03711892b122 service nova] Lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-74c20305-1541-4885-8c82-c43a1f6baaa0 req-1b02ce77-cb2e-4c00-b887-03711892b122 service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] No waiting events found dispatching network-vif-unplugged-35f00ab1-f7ca-45cc-8a65-abdeb7d64815 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-74c20305-1541-4885-8c82-c43a1f6baaa0 req-1b02ce77-cb2e-4c00-b887-03711892b122 service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Received event network-vif-unplugged-35f00ab1-f7ca-45cc-8a65-abdeb7d64815 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:26:34 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Took 0.61 seconds to deallocate network for instance.
Nov 10 21:26:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-7784d89a-e22a-44ee-9eb9-eb002dbb4739 req-5eb3d66a-668d-4c81-83fa-c28d16192f51 service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Received event network-vif-deleted-35f00ab1-f7ca-45cc-8a65-abdeb7d64815 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:35 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9f21f47-2211-4d93-b6e6-7f402ed7bc53 is timed out.
Nov 10 21:26:35 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Successfully detached device vdb from instance c9f21f47-2211-4d93-b6e6-7f402ed7bc53 from the live domain config.
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoQnbKxq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:26:35 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.compute.manager [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:26:35 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Creating image(s)
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Did not create local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Ensure instance console log exists: /opt/stack/data/nova/instances/bedaaab9-85ae-4a82-86ee-77b70f255a29/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Start _get_guest_xml network_info=[{"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '025373af-7342-41cb-8580-15e6c8cd139f', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhbTZOEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bedaaab9-85ae-4a82-86ee-77b70f255a29', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9d40532-507f-473c-b19f-bbe00cf0bb2c', 'serial': 'e9d40532-507f-473c-b19f-bbe00cf0bb2c'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[98943fdd-b53a-47b6-af9b-e72a9e41997c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:26:35 user nova-compute[75285]: No targets found.
Nov 10 21:26:35 user nova-compute[75285]: iSNS:
Nov 10 21:26:35 user nova-compute[75285]: No targets found.
Nov 10 21:26:35 user nova-compute[75285]: STATIC:
Nov 10 21:26:35 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:26:35 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:26:35 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:26:35 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9
Nov 10 21:26:35 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:26:35 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:26:35 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d
Nov 10 21:26:35 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:26:35 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:26:35 user nova-compute[75285]: FIRMWARE:
Nov 10 21:26:35 user nova-compute[75285]: No targets found.
Nov 10 21:26:35 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:26:35 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:26:35 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:26:35 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhbTZOEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:26:35 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a579b63-ad2b-43a4-a591-d16b70055e60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[af544836-c693-4806-b7cc-9f58f3353461]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:26:35 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:26:35 user nova-compute[75285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d (non-flash)
Nov 10 21:26:35 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:26:35 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:26:35 user nova-compute[75285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d (non-flash)
Nov 10 21:26:35 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a04382950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[509e37d8-973e-4baa-a0dd-750ce825e1a2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[61444e08-d171-45a3-b130-066a30c5b15d]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c4fcd2-4f8c-4ba3-8174-084d12efcc17]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f3b1cc-8399-4f34-8552-66217e9c9e8a]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c31f13-85fb-43b8-8ecb-0857bc199758]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Deleted allocations for instance 6b00716e-35ad-4c99-bfae-ad6ffb82133a
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0200e08-98f9-4802-90b7-e42e704c3a26]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d, portal: 172.16.0.220,3260]
Nov 10 21:26:35 user nova-compute[75285]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d, portal: 172.16.0.220,3260] successful.
Nov 10 21:26:35 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e34c21a-0350-4f03-9af7-c176a2525776]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] <== disconnect_volume: return (378ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.299s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:26:35 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:26:35 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[caede207-6fd3-4c8a-881c-0bae193ebd8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:26:35 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44670f6-f77a-49d4-9d0d-ffd7177da614]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c] added
Nov 10 21:26:35 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b56ee63-a8a3-4332-9ed3-090150f69b10 tempest-VolumesNegativeTest-1630007394 tempest-VolumesNegativeTest-1630007394-project-member] Lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.882s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd88b2a6-e7e9-4bf8-9888-ff5b5d8e1773]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cb0d40-662a-4506-b5a0-b06ba536fe1b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UhbTZOEs {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UhbTZOEs" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be507e6-059e-4187-ae21-012ae687d0d8]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UhbTZOEs'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6c1a43-3f57-424c-820a-49db92b1d19c]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f95f31-9f76-4cad-90fc-449b9b852499]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:26:35 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:26:35 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:26:35 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:26:35 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e04ca7-75f8-4964-881d-0308888cabc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260]
Nov 10 21:26:35 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260] successful.
Nov 10 21:26:35 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aaeab6-02a0-40f0-a581-c7b23b499ac0]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[747e6bb4-9dd8-42d0-86c0-568ba2473c68]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:26:35 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:26:35 user nova-compute[75285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:26:35 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:26:35 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:26:35 user nova-compute[75285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:26:35 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[79158f9a-52cd-42b8-9c00-56be2b83d7b8]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:26:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhbTZOEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lazy-loading 'flavor' on Instance uuid c9f21f47-2211-4d93-b6e6-7f402ed7bc53 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8b0b2e28-5bdc-494e-a809-78a0e6ccc070 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.129s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.837s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:36 user nova-compute[75285]: INFO nova.compute.manager [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Terminating instance
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-f1d7c0ed-f703-4121-a324-8d130ad517cd req-6860d1d2-e08b-4075-be6c-979d82a37423 service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Received event network-vif-plugged-35f00ab1-f7ca-45cc-8a65-abdeb7d64815 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f1d7c0ed-f703-4121-a324-8d130ad517cd req-6860d1d2-e08b-4075-be6c-979d82a37423 service nova] Acquiring lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f1d7c0ed-f703-4121-a324-8d130ad517cd req-6860d1d2-e08b-4075-be6c-979d82a37423 service nova] Lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f1d7c0ed-f703-4121-a324-8d130ad517cd req-6860d1d2-e08b-4075-be6c-979d82a37423 service nova] Lock "6b00716e-35ad-4c99-bfae-ad6ffb82133a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-f1d7c0ed-f703-4121-a324-8d130ad517cd req-6860d1d2-e08b-4075-be6c-979d82a37423 service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] No waiting events found dispatching network-vif-plugged-35f00ab1-f7ca-45cc-8a65-abdeb7d64815 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:26:36 user nova-compute[75285]: WARNING nova.compute.manager [req-f1d7c0ed-f703-4121-a324-8d130ad517cd req-6860d1d2-e08b-4075-be6c-979d82a37423 service nova] [instance: 6b00716e-35ad-4c99-bfae-ad6ffb82133a] Received unexpected event network-vif-plugged-35f00ab1-f7ca-45cc-8a65-abdeb7d64815 for instance with vm_state deleted and task_state None.
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] <== connect_volume: return (1643ms) {'type': 'block', 'scsi_wwn': '26239636362336230', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239636362336230', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1954355414',display_name='tempest-ServerActionsTestOtherA-server-1954355414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1954355414',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNocB749eAh1ht70oz3+10TmA+kLO5gT3lO99nuOm/718owWWR2GClqTfZpHiNdbMnB4WiPNwkXG5KSL2FG22jImExVTOG7tujQLm5tLOPWUZCjIe4jEv2VBcQIF83dwVQ==',key_name='tempest-keypair-1851905805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-uduwrehb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:26:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=bedaaab9-85ae-4a82-86ee-77b70f255a29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=70a42471-c66d-4646-83d8-478087cf397f,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a42471-c6') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.objects.instance [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lazy-loading 'pci_devices' on Instance uuid bedaaab9-85ae-4a82-86ee-77b70f255a29 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:26:36 user nova-compute[75285]:   <uuid>bedaaab9-85ae-4a82-86ee-77b70f255a29</uuid>
Nov 10 21:26:36 user nova-compute[75285]:   <name>instance-00000026</name>
Nov 10 21:26:36 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:26:36 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:26:36 user nova-compute[75285]:   <metadata>
Nov 10 21:26:36 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:26:36 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:26:36 user nova-compute[75285]:       <nova:name>tempest-ServerActionsTestOtherA-server-1954355414</nova:name>
Nov 10 21:26:36 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:26:35</nova:creationTime>
Nov 10 21:26:36 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:26:36 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:26:36 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:26:36 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:26:36 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:26:36 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:26:36 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:26:36 user nova-compute[75285]:       <nova:owner>
Nov 10 21:26:36 user nova-compute[75285]:         <nova:user uuid="187d346b3e1b453e8404662727b21a7f">tempest-ServerActionsTestOtherA-1895961867-project-member</nova:user>
Nov 10 21:26:36 user nova-compute[75285]:         <nova:project uuid="e582cea01cf0449fad27fafe0f2d0b4e">tempest-ServerActionsTestOtherA-1895961867</nova:project>
Nov 10 21:26:36 user nova-compute[75285]:       </nova:owner>
Nov 10 21:26:36 user nova-compute[75285]:       <nova:ports>
Nov 10 21:26:36 user nova-compute[75285]:         <nova:port uuid="70a42471-c66d-4646-83d8-478087cf397f">
Nov 10 21:26:36 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 21:26:36 user nova-compute[75285]:         </nova:port>
Nov 10 21:26:36 user nova-compute[75285]:       </nova:ports>
Nov 10 21:26:36 user nova-compute[75285]:     </nova:instance>
Nov 10 21:26:36 user nova-compute[75285]:   </metadata>
Nov 10 21:26:36 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:26:36 user nova-compute[75285]:     <system>
Nov 10 21:26:36 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:26:36 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:26:36 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:26:36 user nova-compute[75285]:       <entry name="serial">bedaaab9-85ae-4a82-86ee-77b70f255a29</entry>
Nov 10 21:26:36 user nova-compute[75285]:       <entry name="uuid">bedaaab9-85ae-4a82-86ee-77b70f255a29</entry>
Nov 10 21:26:36 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:26:36 user nova-compute[75285]:     </system>
Nov 10 21:26:36 user nova-compute[75285]:   </sysinfo>
Nov 10 21:26:36 user nova-compute[75285]:   <os>
Nov 10 21:26:36 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:26:36 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:26:36 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:26:36 user nova-compute[75285]:   </os>
Nov 10 21:26:36 user nova-compute[75285]:   <features>
Nov 10 21:26:36 user nova-compute[75285]:     <acpi/>
Nov 10 21:26:36 user nova-compute[75285]:     <apic/>
Nov 10 21:26:36 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:26:36 user nova-compute[75285]:   </features>
Nov 10 21:26:36 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:26:36 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:26:36 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:26:36 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:26:36 user nova-compute[75285]:   </clock>
Nov 10 21:26:36 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:26:36 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:26:36 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:26:36 user nova-compute[75285]:   </cpu>
Nov 10 21:26:36 user nova-compute[75285]:   <devices>
Nov 10 21:26:36 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:26:36 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:26:36 user nova-compute[75285]:       <source dev="/dev/sdb"/>
Nov 10 21:26:36 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:26:36 user nova-compute[75285]:       <serial>e9d40532-507f-473c-b19f-bbe00cf0bb2c</serial>
Nov 10 21:26:36 user nova-compute[75285]:     </disk>
Nov 10 21:26:36 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:26:36 user nova-compute[75285]:       <mac address="fa:16:3e:13:06:e7"/>
Nov 10 21:26:36 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:26:36 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:26:36 user nova-compute[75285]:       <target dev="tap70a42471-c6"/>
Nov 10 21:26:36 user nova-compute[75285]:     </interface>
Nov 10 21:26:36 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:26:36 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/bedaaab9-85ae-4a82-86ee-77b70f255a29/console.log" append="off"/>
Nov 10 21:26:36 user nova-compute[75285]:     </serial>
Nov 10 21:26:36 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:26:36 user nova-compute[75285]:     <video>
Nov 10 21:26:36 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:26:36 user nova-compute[75285]:     </video>
Nov 10 21:26:36 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:26:36 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:26:36 user nova-compute[75285]:     </rng>
Nov 10 21:26:36 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:26:36 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:26:36 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:26:36 user nova-compute[75285]:     </memballoon>
Nov 10 21:26:36 user nova-compute[75285]:   </devices>
Nov 10 21:26:36 user nova-compute[75285]: </domain>
Nov 10 21:26:36 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1954355414',display_name='tempest-ServerActionsTestOtherA-server-1954355414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1954355414',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNocB749eAh1ht70oz3+10TmA+kLO5gT3lO99nuOm/718owWWR2GClqTfZpHiNdbMnB4WiPNwkXG5KSL2FG22jImExVTOG7tujQLm5tLOPWUZCjIe4jEv2VBcQIF83dwVQ==',key_name='tempest-keypair-1851905805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-uduwrehb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:26:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=bedaaab9-85ae-4a82-86ee-77b70f255a29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=70a42471-c66d-4646-83d8-478087cf397f,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a42471-c6') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG os_vif [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=70a42471-c66d-4646-83d8-478087cf397f,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a42471-c6') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca1c52b7-d388-56de-8ef3-076ef4f459fe', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70a42471-c6, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70a42471-c6, col_values=(('qos', UUID('d25ce1c7-93ea-4250-b58e-a4897ce58e54')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70a42471-c6, col_values=(('external_ids', {'iface-id': '70a42471-c66d-4646-83d8-478087cf397f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:06:e7', 'vm-uuid': 'bedaaab9-85ae-4a82-86ee-77b70f255a29'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:36 user nova-compute[75285]: INFO os_vif [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=70a42471-c66d-4646-83d8-478087cf397f,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a42471-c6')
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:26:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] No VIF found with MAC fa:16:3e:13:06:e7, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-b4289832-066d-4f4d-bf06-548e355d22f2 req-1497974b-de58-4cfc-a092-f6b0a5fad967 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Received event network-vif-unplugged-9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b4289832-066d-4f4d-bf06-548e355d22f2 req-1497974b-de58-4cfc-a092-f6b0a5fad967 service nova] Acquiring lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b4289832-066d-4f4d-bf06-548e355d22f2 req-1497974b-de58-4cfc-a092-f6b0a5fad967 service nova] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-b4289832-066d-4f4d-bf06-548e355d22f2 req-1497974b-de58-4cfc-a092-f6b0a5fad967 service nova] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-b4289832-066d-4f4d-bf06-548e355d22f2 req-1497974b-de58-4cfc-a092-f6b0a5fad967 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] No waiting events found dispatching network-vif-unplugged-9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-b4289832-066d-4f4d-bf06-548e355d22f2 req-1497974b-de58-4cfc-a092-f6b0a5fad967 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Received event network-vif-unplugged-9587f821-c03c-4088-803c-0d1b6f4e5560 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:26:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Instance destroyed successfully.
Nov 10 21:26:37 user nova-compute[75285]: DEBUG nova.objects.instance [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lazy-loading 'resources' on Instance uuid c9f21f47-2211-4d93-b6e6-7f402ed7bc53 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1079720583',display_name='tempest-VolumesSnapshotTestJSON-instance-1079720583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1079720583',id=36,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxsX/MzcioMz8KqrJzswseS1leqI6lhEf62sUCVSqztxJxsMPNF3jGP0BMfqFZHnRspHZDgV22T9SvhfCOEmiOCYENBUVTDMJNRAY1+TE79H+6q7XHQRGCdpQFxTgCGfg==',key_name='tempest-keypair-148056767',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b61b6bd18de14243b858764031ccd52b',ramdisk_id='',reservation_id='r-ehbnr7op',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1530341723',owner_user_name='tempest-VolumesSnapshotTestJSON-1530341723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15813044958a4b52866c3273903d12db',uuid=c9f21f47-2211-4d93-b6e6-7f402ed7bc53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9587f821-c03c-4088-803c-0d1b6f4e5560", "address": "fa:16:3e:de:96:40", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9587f821-c0", "ovs_interfaceid": "9587f821-c03c-4088-803c-0d1b6f4e5560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Converting VIF {"id": "9587f821-c03c-4088-803c-0d1b6f4e5560", "address": "fa:16:3e:de:96:40", "network": {"id": "310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1186819527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b61b6bd18de14243b858764031ccd52b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9587f821-c0", "ovs_interfaceid": "9587f821-c03c-4088-803c-0d1b6f4e5560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:96:40,bridge_name='br-int',has_traffic_filtering=True,id=9587f821-c03c-4088-803c-0d1b6f4e5560,network=Network(310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9587f821-c0') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG os_vif [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:96:40,bridge_name='br-int',has_traffic_filtering=True,id=9587f821-c03c-4088-803c-0d1b6f4e5560,network=Network(310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9587f821-c0') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9587f821-c0, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25bcd6b5-9c20-4dd6-8e68-a654a8f1b3ab) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:37 user nova-compute[75285]: INFO os_vif [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:96:40,bridge_name='br-int',has_traffic_filtering=True,id=9587f821-c03c-4088-803c-0d1b6f4e5560,network=Network(310e0aca-4353-4c6d-8ef3-5e2fbc0ce5be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9587f821-c0')
Nov 10 21:26:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoQnbKxq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:26:37 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:26:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6396be96-3a02-48f4-a858-9e114168f420]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:26:37 user nova-compute[75285]: No targets found.
Nov 10 21:26:37 user nova-compute[75285]: iSNS:
Nov 10 21:26:37 user nova-compute[75285]: No targets found.
Nov 10 21:26:37 user nova-compute[75285]: STATIC:
Nov 10 21:26:37 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:26:37 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:26:37 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:26:37 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9
Nov 10 21:26:37 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:26:37 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:26:37 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c
Nov 10 21:26:37 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:26:37 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:26:37 user nova-compute[75285]: FIRMWARE:
Nov 10 21:26:37 user nova-compute[75285]: No targets found.
Nov 10 21:26:37 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:26:37 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:26:37 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edb3ccd6-d9cf-4caa-b66b-666c98aa1e6d', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdd84b0-f190-4ef6-8af3-bb2757aa2563]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[af255dba-c999-4fb4-abc3-5f43088aaa9f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:26:37 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:26:37 user nova-compute[75285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:26:37 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:26:37 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:26:37 user nova-compute[75285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:26:37 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e45a88b0>, {}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Disconnecting from: [] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] <== disconnect_volume: return (77ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:26:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Deleting instance files /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53_del
Nov 10 21:26:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Deletion of /opt/stack/data/nova/instances/c9f21f47-2211-4d93-b6e6-7f402ed7bc53_del complete
Nov 10 21:26:37 user nova-compute[75285]: INFO nova.compute.manager [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 10 21:26:37 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:26:37 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:26:38 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:26:38 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Took 0.74 seconds to deallocate network for instance.
Nov 10 21:26:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:38 user nova-compute[75285]: WARNING nova.volume.cinder [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Attachment ac84cc03-bb9e-4792-9482-cd1168ebfb0b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ac84cc03-bb9e-4792-9482-cd1168ebfb0b. (HTTP 404) (Request-ID: req-7fa80300-7316-4ed4-936f-c98173026475)
Nov 10 21:26:38 user nova-compute[75285]: INFO nova.compute.manager [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Took 0.05 seconds to detach 1 volumes for instance.
Nov 10 21:26:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-fdefb2cc-a2d4-43d4-b070-388cdde34fe0 req-79b2131f-c573-4739-9642-e091f45cbde9 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received event network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:26:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fdefb2cc-a2d4-43d4-b070-388cdde34fe0 req-79b2131f-c573-4739-9642-e091f45cbde9 service nova] Acquiring lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fdefb2cc-a2d4-43d4-b070-388cdde34fe0 req-79b2131f-c573-4739-9642-e091f45cbde9 service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fdefb2cc-a2d4-43d4-b070-388cdde34fe0 req-79b2131f-c573-4739-9642-e091f45cbde9 service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-fdefb2cc-a2d4-43d4-b070-388cdde34fe0 req-79b2131f-c573-4739-9642-e091f45cbde9 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] No waiting events found dispatching network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:26:38 user nova-compute[75285]: WARNING nova.compute.manager [req-fdefb2cc-a2d4-43d4-b070-388cdde34fe0 req-79b2131f-c573-4739-9642-e091f45cbde9 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received unexpected event network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f for instance with vm_state building and task_state spawning.
Nov 10 21:26:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:39 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:26:39 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:26:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:39 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Deleted allocations for instance c9f21f47-2211-4d93-b6e6-7f402ed7bc53
Nov 10 21:26:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ddf47f84-5675-4891-9b13-f025ada38b38 tempest-VolumesSnapshotTestJSON-1530341723 tempest-VolumesSnapshotTestJSON-1530341723-project-member] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.754s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-bea3fcae-8d05-4673-b03b-28987efe74fb req-3f363c6b-78cd-4531-bc6d-0fc2c605a712 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Received event network-vif-plugged-9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:26:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bea3fcae-8d05-4673-b03b-28987efe74fb req-3f363c6b-78cd-4531-bc6d-0fc2c605a712 service nova] Acquiring lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bea3fcae-8d05-4673-b03b-28987efe74fb req-3f363c6b-78cd-4531-bc6d-0fc2c605a712 service nova] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bea3fcae-8d05-4673-b03b-28987efe74fb req-3f363c6b-78cd-4531-bc6d-0fc2c605a712 service nova] Lock "c9f21f47-2211-4d93-b6e6-7f402ed7bc53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-bea3fcae-8d05-4673-b03b-28987efe74fb req-3f363c6b-78cd-4531-bc6d-0fc2c605a712 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] No waiting events found dispatching network-vif-plugged-9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:26:39 user nova-compute[75285]: WARNING nova.compute.manager [req-bea3fcae-8d05-4673-b03b-28987efe74fb req-3f363c6b-78cd-4531-bc6d-0fc2c605a712 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Received unexpected event network-vif-plugged-9587f821-c03c-4088-803c-0d1b6f4e5560 for instance with vm_state deleted and task_state None.
Nov 10 21:26:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-bea3fcae-8d05-4673-b03b-28987efe74fb req-3f363c6b-78cd-4531-bc6d-0fc2c605a712 service nova] [instance: c9f21f47-2211-4d93-b6e6-7f402ed7bc53] Received event network-vif-deleted-9587f821-c03c-4088-803c-0d1b6f4e5560 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:26:40 user nova-compute[75285]: DEBUG nova.compute.manager [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:26:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:26:40 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Instance spawned successfully.
Nov 10 21:26:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:26:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:26:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:26:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:26:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:26:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:26:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:26:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-d9e0c166-6283-438a-8eeb-e27251cd90b1 req-de7a9cfd-898b-4e8f-82a3-dae7e59d9e7e service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received event network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:26:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d9e0c166-6283-438a-8eeb-e27251cd90b1 req-de7a9cfd-898b-4e8f-82a3-dae7e59d9e7e service nova] Acquiring lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d9e0c166-6283-438a-8eeb-e27251cd90b1 req-de7a9cfd-898b-4e8f-82a3-dae7e59d9e7e service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d9e0c166-6283-438a-8eeb-e27251cd90b1 req-de7a9cfd-898b-4e8f-82a3-dae7e59d9e7e service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-d9e0c166-6283-438a-8eeb-e27251cd90b1 req-de7a9cfd-898b-4e8f-82a3-dae7e59d9e7e service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] No waiting events found dispatching network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:26:40 user nova-compute[75285]: WARNING nova.compute.manager [req-d9e0c166-6283-438a-8eeb-e27251cd90b1 req-de7a9cfd-898b-4e8f-82a3-dae7e59d9e7e service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received unexpected event network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f for instance with vm_state building and task_state spawning.
Nov 10 21:26:41 user nova-compute[75285]: INFO nova.compute.manager [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 10 21:26:41 user nova-compute[75285]: DEBUG nova.compute.manager [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:26:41 user nova-compute[75285]: INFO nova.compute.manager [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Took 32.92 seconds to build instance.
Nov 10 21:26:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fca144c1-985c-4bad-b6a6-52b084d434e6 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.021s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:51 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:26:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:26:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:26:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:26:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:26:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:26:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:26:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:26:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:26:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:26:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:26:55 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:26:55 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid 32d2946b-f299-4b62-9f3b-6c00b0b8858b {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:26:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Updating instance_info_cache with network_info: [{"id": "e351ba01-6d16-40ea-ae88-097b9756cc70", "address": "fa:16:3e:a6:48:80", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape351ba01-6d", "ovs_interfaceid": "e351ba01-6d16-40ea-ae88-097b9756cc70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:26:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-32d2946b-f299-4b62-9f3b-6c00b0b8858b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:26:56 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:26:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:57 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:26:57 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:26:57 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:26:57 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:26:57 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:26:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:26:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:26:57 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:26:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:26:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:26:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:26:58 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:26:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:26:59 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:26:59 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:26:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8266MB free_disk=24.91751480102539GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:26:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:26:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:26:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:26:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:26:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:26:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c7933247-e939-4ede-a431-e91488332000 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:26:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance f7280d37-4576-488e-ab31-45dddecf2f93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:26:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance bedaaab9-85ae-4a82-86ee-77b70f255a29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:26:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:26:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:26:59 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:26:59 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:26:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:26:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:27:00 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:27:00 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:27:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:27:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:27:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:27:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:27:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:27:32 user nova-compute[75285]: INFO nova.compute.claims [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Claim successful on node user
Nov 10 21:27:32 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:27:32 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:27:32 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG nova.policy [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '780e11dc70f54bf88772860118930629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bf2d92f6524ec0af61667a9f06bc49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:27:32 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Creating image(s)
Nov 10 21:27:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "/opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "/opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "/opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:27:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.500s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:27:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:27:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.249s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk 1073741824" returned: 0 in 0.083s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:27:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:33 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Successfully created port: a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:27:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.210s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:33 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:27:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Cannot resize image /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Ensure instance console log exists: /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Successfully updated port: a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquired lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2be34fc-9982-4fcd-a2e4-eecd2afe2379 req-5b38d07e-e221-482b-8abb-4f8758f26abb service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-changed-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2be34fc-9982-4fcd-a2e4-eecd2afe2379 req-5b38d07e-e221-482b-8abb-4f8758f26abb service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Refreshing instance network info cache due to event network-changed-a766133d-524b-49ef-95a1-205b134ceeb9. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2be34fc-9982-4fcd-a2e4-eecd2afe2379 req-5b38d07e-e221-482b-8abb-4f8758f26abb service nova] Acquiring lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updating instance_info_cache with network_info: [{"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Releasing lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Instance network_info: |[{"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2be34fc-9982-4fcd-a2e4-eecd2afe2379 req-5b38d07e-e221-482b-8abb-4f8758f26abb service nova] Acquired lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-e2be34fc-9982-4fcd-a2e4-eecd2afe2379 req-5b38d07e-e221-482b-8abb-4f8758f26abb service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Refreshing network info cache for port a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Start _get_guest_xml network_info=[{"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:27:34 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:27:34 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-525137794',display_name='tempest-AttachVolumeTestJSON-server-525137794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-525137794',id=39,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7CslewLFZpEDkSxi0xOqhMnjfSpBoRGh74QRXv2AvpftFuAfVqDK/0oi/qwx56FgDHg0hXRrn34oXrTuQ0qPKz0m7sH3Nx5In+umv3nh8BqCcmGk4OlTWLjeeWuZhD9Q==',key_name='tempest-keypair-774230573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63bf2d92f6524ec0af61667a9f06bc49',ramdisk_id='',reservation_id='r-vbyj8al6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-738528264',owner_user_name='tempest-AttachVolumeTestJSON-738528264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:27:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780e11dc70f54bf88772860118930629',uuid=9114d033-d5c9-45df-a865-78b8a977ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converting VIF {"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'pci_devices' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:27:34 user nova-compute[75285]:   <uuid>9114d033-d5c9-45df-a865-78b8a977ffcc</uuid>
Nov 10 21:27:34 user nova-compute[75285]:   <name>instance-00000027</name>
Nov 10 21:27:34 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:27:34 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:27:34 user nova-compute[75285]:   <metadata>
Nov 10 21:27:34 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:27:34 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:27:34 user nova-compute[75285]:       <nova:name>tempest-AttachVolumeTestJSON-server-525137794</nova:name>
Nov 10 21:27:34 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:27:34</nova:creationTime>
Nov 10 21:27:34 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:27:34 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:27:34 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:27:34 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:27:34 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:27:34 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:27:34 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:27:34 user nova-compute[75285]:       <nova:owner>
Nov 10 21:27:34 user nova-compute[75285]:         <nova:user uuid="780e11dc70f54bf88772860118930629">tempest-AttachVolumeTestJSON-738528264-project-member</nova:user>
Nov 10 21:27:34 user nova-compute[75285]:         <nova:project uuid="63bf2d92f6524ec0af61667a9f06bc49">tempest-AttachVolumeTestJSON-738528264</nova:project>
Nov 10 21:27:34 user nova-compute[75285]:       </nova:owner>
Nov 10 21:27:34 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:27:34 user nova-compute[75285]:       <nova:ports>
Nov 10 21:27:34 user nova-compute[75285]:         <nova:port uuid="a766133d-524b-49ef-95a1-205b134ceeb9">
Nov 10 21:27:34 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 21:27:34 user nova-compute[75285]:         </nova:port>
Nov 10 21:27:34 user nova-compute[75285]:       </nova:ports>
Nov 10 21:27:34 user nova-compute[75285]:     </nova:instance>
Nov 10 21:27:34 user nova-compute[75285]:   </metadata>
Nov 10 21:27:34 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:27:34 user nova-compute[75285]:     <system>
Nov 10 21:27:34 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:27:34 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:27:34 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:27:34 user nova-compute[75285]:       <entry name="serial">9114d033-d5c9-45df-a865-78b8a977ffcc</entry>
Nov 10 21:27:34 user nova-compute[75285]:       <entry name="uuid">9114d033-d5c9-45df-a865-78b8a977ffcc</entry>
Nov 10 21:27:34 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:27:34 user nova-compute[75285]:     </system>
Nov 10 21:27:34 user nova-compute[75285]:   </sysinfo>
Nov 10 21:27:34 user nova-compute[75285]:   <os>
Nov 10 21:27:34 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:27:34 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:27:34 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:27:34 user nova-compute[75285]:   </os>
Nov 10 21:27:34 user nova-compute[75285]:   <features>
Nov 10 21:27:34 user nova-compute[75285]:     <acpi/>
Nov 10 21:27:34 user nova-compute[75285]:     <apic/>
Nov 10 21:27:34 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:27:34 user nova-compute[75285]:   </features>
Nov 10 21:27:34 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:27:34 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:27:34 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:27:34 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:27:34 user nova-compute[75285]:   </clock>
Nov 10 21:27:34 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:27:34 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:27:34 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:27:34 user nova-compute[75285]:   </cpu>
Nov 10 21:27:34 user nova-compute[75285]:   <devices>
Nov 10 21:27:34 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:27:34 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:27:34 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk"/>
Nov 10 21:27:34 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:27:34 user nova-compute[75285]:     </disk>
Nov 10 21:27:34 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:27:34 user nova-compute[75285]:       <mac address="fa:16:3e:1c:34:4b"/>
Nov 10 21:27:34 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:27:34 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:27:34 user nova-compute[75285]:       <target dev="tapa766133d-52"/>
Nov 10 21:27:34 user nova-compute[75285]:     </interface>
Nov 10 21:27:34 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:27:34 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/console.log" append="off"/>
Nov 10 21:27:34 user nova-compute[75285]:     </serial>
Nov 10 21:27:34 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:27:34 user nova-compute[75285]:     <video>
Nov 10 21:27:34 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:27:34 user nova-compute[75285]:     </video>
Nov 10 21:27:34 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:27:34 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:27:34 user nova-compute[75285]:     </rng>
Nov 10 21:27:34 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:27:34 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:27:34 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:27:34 user nova-compute[75285]:     </memballoon>
Nov 10 21:27:34 user nova-compute[75285]:   </devices>
Nov 10 21:27:34 user nova-compute[75285]: </domain>
Nov 10 21:27:34 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-525137794',display_name='tempest-AttachVolumeTestJSON-server-525137794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-525137794',id=39,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7CslewLFZpEDkSxi0xOqhMnjfSpBoRGh74QRXv2AvpftFuAfVqDK/0oi/qwx56FgDHg0hXRrn34oXrTuQ0qPKz0m7sH3Nx5In+umv3nh8BqCcmGk4OlTWLjeeWuZhD9Q==',key_name='tempest-keypair-774230573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63bf2d92f6524ec0af61667a9f06bc49',ramdisk_id='',reservation_id='r-vbyj8al6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-738528264',owner_user_name='tempest-AttachVolumeTestJSON-738528264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:27:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780e11dc70f54bf88772860118930629',uuid=9114d033-d5c9-45df-a865-78b8a977ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converting VIF {"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG os_vif [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4d378a0-5689-5745-9e6f-002dd9519596', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa766133d-52, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa766133d-52, col_values=(('qos', UUID('75156cec-0633-4ab9-a077-d34a1cc404cf')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa766133d-52, col_values=(('external_ids', {'iface-id': 'a766133d-524b-49ef-95a1-205b134ceeb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:34:4b', 'vm-uuid': '9114d033-d5c9-45df-a865-78b8a977ffcc'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:27:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:35 user nova-compute[75285]: INFO os_vif [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52')
Nov 10 21:27:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:27:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] No VIF found with MAC fa:16:3e:1c:34:4b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:27:35 user nova-compute[75285]: DEBUG nova.network.neutron [req-e2be34fc-9982-4fcd-a2e4-eecd2afe2379 req-5b38d07e-e221-482b-8abb-4f8758f26abb service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updated VIF entry in instance network info cache for port a766133d-524b-49ef-95a1-205b134ceeb9. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:27:35 user nova-compute[75285]: DEBUG nova.network.neutron [req-e2be34fc-9982-4fcd-a2e4-eecd2afe2379 req-5b38d07e-e221-482b-8abb-4f8758f26abb service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updating instance_info_cache with network_info: [{"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:27:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2be34fc-9982-4fcd-a2e4-eecd2afe2379 req-5b38d07e-e221-482b-8abb-4f8758f26abb service nova] Releasing lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:27:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-51cb1edc-388b-4beb-9160-4b5c63fcc43a req-2d37f398-dfa0-46c4-a083-0ddc960d729e service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:27:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-51cb1edc-388b-4beb-9160-4b5c63fcc43a req-2d37f398-dfa0-46c4-a083-0ddc960d729e service nova] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:27:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-51cb1edc-388b-4beb-9160-4b5c63fcc43a req-2d37f398-dfa0-46c4-a083-0ddc960d729e service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:27:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-51cb1edc-388b-4beb-9160-4b5c63fcc43a req-2d37f398-dfa0-46c4-a083-0ddc960d729e service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:27:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-51cb1edc-388b-4beb-9160-4b5c63fcc43a req-2d37f398-dfa0-46c4-a083-0ddc960d729e service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] No waiting events found dispatching network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:27:36 user nova-compute[75285]: WARNING nova.compute.manager [req-51cb1edc-388b-4beb-9160-4b5c63fcc43a req-2d37f398-dfa0-46c4-a083-0ddc960d729e service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received unexpected event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 for instance with vm_state building and task_state spawning.
Nov 10 21:27:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:27:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:27:38 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Instance spawned successfully.
Nov 10 21:27:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:27:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:27:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:27:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:27:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:27:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:27:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:27:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-1abf22c1-e1d4-4d9e-9894-09bf1ed253ed req-297e0617-3b2b-413c-a586-35bf0ca96586 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:27:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1abf22c1-e1d4-4d9e-9894-09bf1ed253ed req-297e0617-3b2b-413c-a586-35bf0ca96586 service nova] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:27:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1abf22c1-e1d4-4d9e-9894-09bf1ed253ed req-297e0617-3b2b-413c-a586-35bf0ca96586 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:27:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1abf22c1-e1d4-4d9e-9894-09bf1ed253ed req-297e0617-3b2b-413c-a586-35bf0ca96586 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:27:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-1abf22c1-e1d4-4d9e-9894-09bf1ed253ed req-297e0617-3b2b-413c-a586-35bf0ca96586 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] No waiting events found dispatching network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:27:38 user nova-compute[75285]: WARNING nova.compute.manager [req-1abf22c1-e1d4-4d9e-9894-09bf1ed253ed req-297e0617-3b2b-413c-a586-35bf0ca96586 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received unexpected event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 for instance with vm_state building and task_state spawning.
Nov 10 21:27:38 user nova-compute[75285]: INFO nova.compute.manager [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 10 21:27:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:27:38 user nova-compute[75285]: INFO nova.compute.manager [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Took 6.83 seconds to build instance.
Nov 10 21:27:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8935bfe3-748d-402f-9d3f-19b88c5faf65 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.957s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "f7280d37-4576-488e-ab31-45dddecf2f93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:27:39 user nova-compute[75285]: INFO nova.compute.manager [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Terminating instance
Nov 10 21:27:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:39 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Instance destroyed successfully.
Nov 10 21:27:39 user nova-compute[75285]: DEBUG nova.objects.instance [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'resources' on Instance uuid f7280d37-4576-488e-ab31-45dddecf2f93 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:21:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1144674436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1144674436',id=34,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:24:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9957f55c59044088e94338564e04092',ramdisk_id='',reservation_id='r-kaz9xqte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-396261753',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:25:53Z,user_data=None,user_id='ac13c724170f47368e5a395110c631b7',uuid=f7280d37-4576-488e-ab31-45dddecf2f93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converting VIF {"id": "a7af338b-7f5a-4847-9746-a770f1182b11", "address": "fa:16:3e:f9:a0:f4", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7af338b-7f", "ovs_interfaceid": "a7af338b-7f5a-4847-9746-a770f1182b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:a0:f4,bridge_name='br-int',has_traffic_filtering=True,id=a7af338b-7f5a-4847-9746-a770f1182b11,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7af338b-7f') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG os_vif [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:a0:f4,bridge_name='br-int',has_traffic_filtering=True,id=a7af338b-7f5a-4847-9746-a770f1182b11,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7af338b-7f') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7af338b-7f, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=920b2612-6d5e-444b-9dff-85b380dc3ad9) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:27:39 user nova-compute[75285]: INFO os_vif [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:a0:f4,bridge_name='br-int',has_traffic_filtering=True,id=a7af338b-7f5a-4847-9746-a770f1182b11,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7af338b-7f')
Nov 10 21:27:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqpSXRkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:27:39 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:27:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b18d48-27b0-4d2a-b734-ea680688bb63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:27:39 user nova-compute[75285]: No targets found.
Nov 10 21:27:39 user nova-compute[75285]: iSNS:
Nov 10 21:27:39 user nova-compute[75285]: No targets found.
Nov 10 21:27:39 user nova-compute[75285]: STATIC:
Nov 10 21:27:39 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:27:39 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:27:39 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:27:39 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9
Nov 10 21:27:39 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:27:39 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:27:39 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c
Nov 10 21:27:39 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:27:39 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:27:39 user nova-compute[75285]: FIRMWARE:
Nov 10 21:27:39 user nova-compute[75285]: No targets found.
Nov 10 21:27:39 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:27:39 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:27:39 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ec8719-6935-4bbd-9e28-4c3de6b0491d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0894f239-9b46-46fd-8d9b-ac3add553beb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:27:39 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:27:39 user nova-compute[75285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:27:39 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:27:39 user nova-compute[75285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 (non-flash)
Nov 10 21:27:39 user nova-compute[75285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:27:39 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a045fecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9'): ({'sdf'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Removing single pathed devices sdf {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.041s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b73bcc5-23e0-4747-a199-e41978ad0cd6]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ee67d9-27c1-49be-82ac-195f1c71f6c5]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Flushing IO for device /dev/sdf {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.028s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[004244b9-ffd9-453b-8eda-adb6da15e373]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5155361-cb8e-4f8b-99c1-a2934fc3242e]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] SCSI volumes sdf have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23336376261396662', '/dev/disk/by-id/scsi-1SCST_BIOc3d67899-367ba9fbd6cc53ef', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c3d67899') {{(pid=86427) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 21:27:40 user nova-compute[75285]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23336376261396662
Nov 10 21:27:40 user nova-compute[75285]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOc3d67899-367ba9fbd6cc53ef
Nov 10 21:27:40 user nova-compute[75285]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_c3d67899
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f5185e-4f78-460e-84c6-334d73427c27]: (4, None) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3587e70-941b-4cd8-a203-c7d49e45f8b4]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a682fa0e-cbf3-46b7-8121-305a3a86e052]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9, portal: 172.16.0.220,3260]
Nov 10 21:27:40 user nova-compute[75285]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9, portal: 172.16.0.220,3260] successful.
Nov 10 21:27:40 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9955d9-3201-4a6b-bc7a-f7b4c0cde6b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[482014cb-f9f7-4425-ba6c-b34a791e1c8a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] <== disconnect_volume: return (407ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:27:40 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Deleting instance files /opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93_del
Nov 10 21:27:40 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Deletion of /opt/stack/data/nova/instances/f7280d37-4576-488e-ab31-45dddecf2f93_del complete
Nov 10 21:27:40 user nova-compute[75285]: INFO nova.compute.manager [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-4931c563-8c8b-46ff-bdb8-9d7aee210f7e req-9b7d4e61-bf6c-40bb-839c-ed00309888ef service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-vif-unplugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4931c563-8c8b-46ff-bdb8-9d7aee210f7e req-9b7d4e61-bf6c-40bb-839c-ed00309888ef service nova] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4931c563-8c8b-46ff-bdb8-9d7aee210f7e req-9b7d4e61-bf6c-40bb-839c-ed00309888ef service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4931c563-8c8b-46ff-bdb8-9d7aee210f7e req-9b7d4e61-bf6c-40bb-839c-ed00309888ef service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-4931c563-8c8b-46ff-bdb8-9d7aee210f7e req-9b7d4e61-bf6c-40bb-839c-ed00309888ef service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] No waiting events found dispatching network-vif-unplugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-4931c563-8c8b-46ff-bdb8-9d7aee210f7e req-9b7d4e61-bf6c-40bb-839c-ed00309888ef service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-vif-unplugged-a7af338b-7f5a-4847-9746-a770f1182b11 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-4931c563-8c8b-46ff-bdb8-9d7aee210f7e req-9b7d4e61-bf6c-40bb-839c-ed00309888ef service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4931c563-8c8b-46ff-bdb8-9d7aee210f7e req-9b7d4e61-bf6c-40bb-839c-ed00309888ef service nova] Acquiring lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4931c563-8c8b-46ff-bdb8-9d7aee210f7e req-9b7d4e61-bf6c-40bb-839c-ed00309888ef service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4931c563-8c8b-46ff-bdb8-9d7aee210f7e req-9b7d4e61-bf6c-40bb-839c-ed00309888ef service nova] Lock "f7280d37-4576-488e-ab31-45dddecf2f93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:27:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-4931c563-8c8b-46ff-bdb8-9d7aee210f7e req-9b7d4e61-bf6c-40bb-839c-ed00309888ef service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] No waiting events found dispatching network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:27:40 user nova-compute[75285]: WARNING nova.compute.manager [req-4931c563-8c8b-46ff-bdb8-9d7aee210f7e req-9b7d4e61-bf6c-40bb-839c-ed00309888ef service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received unexpected event network-vif-plugged-a7af338b-7f5a-4847-9746-a770f1182b11 for instance with vm_state active and task_state deleting.
Nov 10 21:27:40 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:27:40 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Took 0.56 seconds to deallocate network for instance.
Nov 10 21:27:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-dc51122b-e7a1-4fe5-b1a2-34a35247cc36 req-fb7520fd-ce27-40db-a0e6-e54c1cd434a2 service nova] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Received event network-vif-deleted-a7af338b-7f5a-4847-9746-a770f1182b11 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:27:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:41 user nova-compute[75285]: INFO nova.compute.manager [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: f7280d37-4576-488e-ab31-45dddecf2f93] Took 1.05 seconds to detach 1 volumes for instance.
Nov 10 21:27:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:27:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:27:42 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:27:42 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:27:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:27:42 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Deleted allocations for instance f7280d37-4576-488e-ab31-45dddecf2f93
Nov 10 21:27:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-58b6e070-7b86-420e-9263-3ec5895b5023 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "f7280d37-4576-488e-ab31-45dddecf2f93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.484s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:27:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:27:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:27:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:27:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:27:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:52 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:27:54 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:27:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:27:55 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:27:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:27:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:27:55 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:27:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Updating instance_info_cache with network_info: [{"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:27:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-ac0ddf13-9584-4e5d-99be-ad8feb6c532f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:27:56 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:27:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:57 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:27:58 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:27:58 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-004175fd-0b8d-4475-9ff7-17342994a456 req-1170ab35-e449-437c-87f8-ab8a36a6defc service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Received event network-changed-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-004175fd-0b8d-4475-9ff7-17342994a456 req-1170ab35-e449-437c-87f8-ab8a36a6defc service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Refreshing instance network info cache due to event network-changed-a04ef93a-fdc5-4229-a69a-1b2daf6f5995. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-004175fd-0b8d-4475-9ff7-17342994a456 req-1170ab35-e449-437c-87f8-ab8a36a6defc service nova] Acquiring lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-004175fd-0b8d-4475-9ff7-17342994a456 req-1170ab35-e449-437c-87f8-ab8a36a6defc service nova] Acquired lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG nova.network.neutron [req-004175fd-0b8d-4475-9ff7-17342994a456 req-1170ab35-e449-437c-87f8-ab8a36a6defc service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Refreshing network info cache for port a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG nova.network.neutron [req-004175fd-0b8d-4475-9ff7-17342994a456 req-1170ab35-e449-437c-87f8-ab8a36a6defc service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updated VIF entry in instance network info cache for port a04ef93a-fdc5-4229-a69a-1b2daf6f5995. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG nova.network.neutron [req-004175fd-0b8d-4475-9ff7-17342994a456 req-1170ab35-e449-437c-87f8-ab8a36a6defc service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updating instance_info_cache with network_info: [{"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-004175fd-0b8d-4475-9ff7-17342994a456 req-1170ab35-e449-437c-87f8-ab8a36a6defc service nova] Releasing lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:27:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG nova.compute.manager [req-ea2b9e69-e18f-473c-b1fa-2145ddf9a3ef req-e3c68e79-c5f9-4f21-b638-1d0e885d90e7 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received event network-changed-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG nova.compute.manager [req-ea2b9e69-e18f-473c-b1fa-2145ddf9a3ef req-e3c68e79-c5f9-4f21-b638-1d0e885d90e7 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Refreshing instance network info cache due to event network-changed-70a42471-c66d-4646-83d8-478087cf397f. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ea2b9e69-e18f-473c-b1fa-2145ddf9a3ef req-e3c68e79-c5f9-4f21-b638-1d0e885d90e7 service nova] Acquiring lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ea2b9e69-e18f-473c-b1fa-2145ddf9a3ef req-e3c68e79-c5f9-4f21-b638-1d0e885d90e7 service nova] Acquired lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG nova.network.neutron [req-ea2b9e69-e18f-473c-b1fa-2145ddf9a3ef req-e3c68e79-c5f9-4f21-b638-1d0e885d90e7 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Refreshing network info cache for port 70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Stashing vm_state: active {{(pid=75285) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG nova.network.neutron [req-ea2b9e69-e18f-473c-b1fa-2145ddf9a3ef req-e3c68e79-c5f9-4f21-b638-1d0e885d90e7 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updated VIF entry in instance network info cache for port 70a42471-c66d-4646-83d8-478087cf397f. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG nova.network.neutron [req-ea2b9e69-e18f-473c-b1fa-2145ddf9a3ef req-e3c68e79-c5f9-4f21-b638-1d0e885d90e7 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updating instance_info_cache with network_info: [{"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:28:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ea2b9e69-e18f-473c-b1fa-2145ddf9a3ef req-e3c68e79-c5f9-4f21-b638-1d0e885d90e7 service nova] Releasing lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:02 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:28:02 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8245MB free_disk=24.877498626708984GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:28:02 user nova-compute[75285]: INFO nova.compute.claims [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Claim successful on node user
Nov 10 21:28:02 user nova-compute[75285]: INFO nova.compute.resource_tracker [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updating resource usage from migration 67bebab3-f76a-4089-9ac0-5a84a2621d07
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.359s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:28:02 user nova-compute[75285]: INFO nova.compute.manager [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Migrating
Nov 10 21:28:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.347s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:28:02 user nova-compute[75285]: INFO nova.compute.rpcapi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 10 21:28:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquired lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.network.neutron [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Applying migration context for instance bedaaab9-85ae-4a82-86ee-77b70f255a29 as it has an incoming, in-progress migration 67bebab3-f76a-4089-9ac0-5a84a2621d07. Migration status is pre-migrating {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 21:28:02 user nova-compute[75285]: INFO nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updating resource usage from migration 67bebab3-f76a-4089-9ac0-5a84a2621d07
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c7933247-e939-4ede-a431-e91488332000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 9114d033-d5c9-45df-a865-78b8a977ffcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Migration 67bebab3-f76a-4089-9ac0-5a84a2621d07 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance bedaaab9-85ae-4a82-86ee-77b70f255a29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:28:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.490s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:28:03 user nova-compute[75285]: DEBUG nova.network.neutron [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updating instance_info_cache with network_info: [{"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:28:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Releasing lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:28:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Starting migrate_disk_and_power_off {{(pid=75285) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 10 21:28:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-f9de782f-25e3-4b61-aed4-6b6a1574fda0 req-289b9e8b-c8e4-45b7-b736-ab45a3a9f2bb service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received event network-vif-unplugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:28:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f9de782f-25e3-4b61-aed4-6b6a1574fda0 req-289b9e8b-c8e4-45b7-b736-ab45a3a9f2bb service nova] Acquiring lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:28:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f9de782f-25e3-4b61-aed4-6b6a1574fda0 req-289b9e8b-c8e4-45b7-b736-ab45a3a9f2bb service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:28:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f9de782f-25e3-4b61-aed4-6b6a1574fda0 req-289b9e8b-c8e4-45b7-b736-ab45a3a9f2bb service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:28:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-f9de782f-25e3-4b61-aed4-6b6a1574fda0 req-289b9e8b-c8e4-45b7-b736-ab45a3a9f2bb service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] No waiting events found dispatching network-vif-unplugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:28:03 user nova-compute[75285]: WARNING nova.compute.manager [req-f9de782f-25e3-4b61-aed4-6b6a1574fda0 req-289b9e8b-c8e4-45b7-b736-ab45a3a9f2bb service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received unexpected event network-vif-unplugged-70a42471-c66d-4646-83d8-478087cf397f for instance with vm_state active and task_state resize_migrating.
Nov 10 21:28:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:03 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:28:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:04 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Instance destroyed successfully.
Nov 10 21:28:04 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1954355414',display_name='tempest-ServerActionsTestOtherA-server-1954355414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1954355414',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNocB749eAh1ht70oz3+10TmA+kLO5gT3lO99nuOm/718owWWR2GClqTfZpHiNdbMnB4WiPNwkXG5KSL2FG22jImExVTOG7tujQLm5tLOPWUZCjIe4jEv2VBcQIF83dwVQ==',key_name='tempest-keypair-1851905805',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:26:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-uduwrehb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=bedaaab9-85ae-4a82-86ee-77b70f255a29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1142413850-network", "vif_mac": "fa:16:3e:13:06:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1142413850-network", "vif_mac": "fa:16:3e:13:06:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=70a42471-c66d-4646-83d8-478087cf397f,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a42471-c6') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_vif [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=70a42471-c66d-4646-83d8-478087cf397f,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a42471-c6') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70a42471-c6, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d25ce1c7-93ea-4250-b58e-a4897ce58e54) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:04 user nova-compute[75285]: INFO os_vif [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=70a42471-c66d-4646-83d8-478087cf397f,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a42471-c6')
Nov 10 21:28:04 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhbTZOEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:28:04 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[39203584-8101-429a-b910-b96702f5eb85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:28:04 user nova-compute[75285]: No targets found.
Nov 10 21:28:04 user nova-compute[75285]: iSNS:
Nov 10 21:28:04 user nova-compute[75285]: No targets found.
Nov 10 21:28:04 user nova-compute[75285]: STATIC:
Nov 10 21:28:04 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:28:04 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:28:04 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:28:04 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c
Nov 10 21:28:04 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:28:04 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:28:04 user nova-compute[75285]: FIRMWARE:
Nov 10 21:28:04 user nova-compute[75285]: No targets found.
Nov 10 21:28:04 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:28:04 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:28:04 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff4a85d-3e6b-4e2d-882f-3d3826a3f8f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df97ace-2c95-4951-ac96-b1f278e17f58]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:28:04 user nova-compute[75285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:28:04 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:28:04 user nova-compute[75285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:28:04 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e4500550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8631f82d-1d18-4609-8531-ae1c6f4e0cde]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[93491406-c4cc-417f-a8eb-2dbf65bab376]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[90af975d-dcc4-4503-9b89-2f987d0b2aef]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64ed859-03c8-4922-b731-25f2545321c0]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d11bdde3', '/dev/disk/by-id/scsi-26239636362336230', '/dev/disk/by-id/scsi-1SCST_BIOd11bdde3-b9ccb3b0509d424c') {{(pid=86427) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b062527c-3a25-4d6c-bfb0-92909be82264]: (4, None) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ef8024-4cd3-478e-923c-562017ac6df0]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8970f30e-8b60-474a-9e49-1f155bb835e7]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260]
Nov 10 21:28:04 user nova-compute[75285]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260] successful.
Nov 10 21:28:04 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7603ca20-c392-40c9-b09e-e4700b1f4ad7]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] <== disconnect_volume: return (323ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:28:04 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:28:05 user nova-compute[75285]: DEBUG nova.compute.manager [req-35b544cf-bafa-4b7f-ab91-dfc7e542af29 req-17ad99a8-2e49-448a-9711-e610a89e8b4c service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received event network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:28:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-35b544cf-bafa-4b7f-ab91-dfc7e542af29 req-17ad99a8-2e49-448a-9711-e610a89e8b4c service nova] Acquiring lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:28:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-35b544cf-bafa-4b7f-ab91-dfc7e542af29 req-17ad99a8-2e49-448a-9711-e610a89e8b4c service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:28:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-35b544cf-bafa-4b7f-ab91-dfc7e542af29 req-17ad99a8-2e49-448a-9711-e610a89e8b4c service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:28:05 user nova-compute[75285]: DEBUG nova.compute.manager [req-35b544cf-bafa-4b7f-ab91-dfc7e542af29 req-17ad99a8-2e49-448a-9711-e610a89e8b4c service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] No waiting events found dispatching network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:28:05 user nova-compute[75285]: WARNING nova.compute.manager [req-35b544cf-bafa-4b7f-ab91-dfc7e542af29 req-17ad99a8-2e49-448a-9711-e610a89e8b4c service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received unexpected event network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f for instance with vm_state active and task_state resize_migrating.
Nov 10 21:28:06 user nova-compute[75285]: DEBUG nova.network.neutron [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Port 70a42471-c66d-4646-83d8-478087cf397f binding to destination host user is already ACTIVE {{(pid=75285) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquired lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG nova.network.neutron [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG nova.network.neutron [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updating instance_info_cache with network_info: [{"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Releasing lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG os_brick.utils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aa8ac0-2580-45a6-8abd-fc552cf4ca33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5372062d-787c-417f-9cfe-0307acd37a70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ecb84d-4459-41ab-9b68-efeeb9f83852]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:07 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd2d2a8-4c05-422a-b74b-e66cfc6d55a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:28:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:28:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:28:07 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:28:07 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[368ac64e-f78d-4707-a04d-6bc226f13cf1]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:28:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:28:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:28:07 user nova-compute[75285]: DEBUG os_brick.utils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:28:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:28:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:28:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "c7933247-e939-4ede-a431-e91488332000" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:28:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "c7933247-e939-4ede-a431-e91488332000" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:28:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "c7933247-e939-4ede-a431-e91488332000-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:28:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "c7933247-e939-4ede-a431-e91488332000-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:28:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "c7933247-e939-4ede-a431-e91488332000-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:28:29 user nova-compute[75285]: INFO nova.compute.manager [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Terminating instance
Nov 10 21:28:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:28:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-53b8573d-b613-42b9-b401-bfe7fcbd1295 req-0c0e9ae2-09fd-4de8-998e-e76b4be84e99 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] Received event network-vif-unplugged-7f3d9d05-a605-443b-9d66-d14510aefb9a {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-53b8573d-b613-42b9-b401-bfe7fcbd1295 req-0c0e9ae2-09fd-4de8-998e-e76b4be84e99 service nova] Acquiring lock "c7933247-e939-4ede-a431-e91488332000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-53b8573d-b613-42b9-b401-bfe7fcbd1295 req-0c0e9ae2-09fd-4de8-998e-e76b4be84e99 service nova] Lock "c7933247-e939-4ede-a431-e91488332000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-53b8573d-b613-42b9-b401-bfe7fcbd1295 req-0c0e9ae2-09fd-4de8-998e-e76b4be84e99 service nova] Lock "c7933247-e939-4ede-a431-e91488332000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-53b8573d-b613-42b9-b401-bfe7fcbd1295 req-0c0e9ae2-09fd-4de8-998e-e76b4be84e99 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] No waiting events found dispatching network-vif-unplugged-7f3d9d05-a605-443b-9d66-d14510aefb9a {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-53b8573d-b613-42b9-b401-bfe7fcbd1295 req-0c0e9ae2-09fd-4de8-998e-e76b4be84e99 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] Received event network-vif-unplugged-7f3d9d05-a605-443b-9d66-d14510aefb9a for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:28:30 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: c7933247-e939-4ede-a431-e91488332000] Instance destroyed successfully.
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.objects.instance [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'resources' on Instance uuid c7933247-e939-4ede-a431-e91488332000 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1637790931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1637790931',id=30,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:18:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9957f55c59044088e94338564e04092',ramdisk_id='',reservation_id='r-v4t0n5uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-396261753',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:20:13Z,user_data=None,user_id='ac13c724170f47368e5a395110c631b7',uuid=c7933247-e939-4ede-a431-e91488332000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "address": "fa:16:3e:5e:ca:1a", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3d9d05-a6", "ovs_interfaceid": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converting VIF {"id": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "address": "fa:16:3e:5e:ca:1a", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f3d9d05-a6", "ovs_interfaceid": "7f3d9d05-a605-443b-9d66-d14510aefb9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:ca:1a,bridge_name='br-int',has_traffic_filtering=True,id=7f3d9d05-a605-443b-9d66-d14510aefb9a,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f3d9d05-a6') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG os_vif [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:ca:1a,bridge_name='br-int',has_traffic_filtering=True,id=7f3d9d05-a605-443b-9d66-d14510aefb9a,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f3d9d05-a6') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f3d9d05-a6, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d166fd3-c9be-4f6b-852f-7ecda426906e) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:28:30 user nova-compute[75285]: INFO os_vif [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:ca:1a,bridge_name='br-int',has_traffic_filtering=True,id=7f3d9d05-a605-443b-9d66-d14510aefb9a,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f3d9d05-a6')
Nov 10 21:28:30 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Deleting instance files /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000_del
Nov 10 21:28:30 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Deletion of /opt/stack/data/nova/instances/c7933247-e939-4ede-a431-e91488332000_del complete
Nov 10 21:28:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:30 user nova-compute[75285]: INFO nova.compute.manager [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: c7933247-e939-4ede-a431-e91488332000] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 10 21:28:30 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: c7933247-e939-4ede-a431-e91488332000] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: c7933247-e939-4ede-a431-e91488332000] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Starting finish_migration {{(pid=75285) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Instance directory exists: not creating {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 21:28:30 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Creating image(s)
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Did not create local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Ensure instance console log exists: /opt/stack/data/nova/instances/bedaaab9-85ae-4a82-86ee-77b70f255a29/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Start _get_guest_xml network_info=[{"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1142413850-network", "vif_mac": "fa:16:3e:13:06:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '49646a8c-d416-4aaf-a8d7-09b0ffe8a55d', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhbTZOEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bedaaab9-85ae-4a82-86ee-77b70f255a29', 'attached_at': '2023-11-10T21:28:31.000000', 'detached_at': '', 'volume_id': 'e9d40532-507f-473c-b19f-bbe00cf0bb2c', 'serial': 'e9d40532-507f-473c-b19f-bbe00cf0bb2c'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:28:30 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:28:30 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhbTZOEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:28:30 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:28:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:28:30 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:28:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:28:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:28:30 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:28:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fa42d6-f8fa-4cca-b233-6071b9d375f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:28:31 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eee25d-039a-4b99-8ad9-e58b63be8db1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c] added
Nov 10 21:28:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e7058b-ad25-4377-bf63-44a99a10893c]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: c7933247-e939-4ede-a431-e91488332000] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:31 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: c7933247-e939-4ede-a431-e91488332000] Took 0.45 seconds to deallocate network for instance.
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9f4353-450f-4a17-a609-f390f13d9985]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UhbTZOEs {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UhbTZOEs" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[86225af4-4cf1-489c-8814-ab40e84fdd22]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UhbTZOEs'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb7f898-eabf-45d7-a49f-65afebcf530c]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff26de3-a19d-410b-8e92-b11d9ca84811]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:28:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:28:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3e493b-506a-4c93-bcae-efa1ae30cd56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260]
Nov 10 21:28:31 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260] successful.
Nov 10 21:28:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[317e7647-c31c-4d0d-8d3c-a8a633c9ac54]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bcf408-dda8-4ae0-9af2-f0700ee9fa58]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:28:31 user nova-compute[75285]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:28:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:28:31 user nova-compute[75285]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:28:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f75f3c8-4178-4802-9d97-9bfbcb878224]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhbTZOEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:28:31 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Deleted allocations for instance c7933247-e939-4ede-a431-e91488332000
Nov 10 21:28:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1526030c-9454-4f23-b7c7-647ac5b4f1de tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "c7933247-e939-4ede-a431-e91488332000" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.654s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26239636362336230', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239636362336230', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1954355414',display_name='tempest-ServerActionsTestOtherA-server-1954355414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1954355414',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNocB749eAh1ht70oz3+10TmA+kLO5gT3lO99nuOm/718owWWR2GClqTfZpHiNdbMnB4WiPNwkXG5KSL2FG22jImExVTOG7tujQLm5tLOPWUZCjIe4jEv2VBcQIF83dwVQ==',key_name='tempest-keypair-1851905805',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:26:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-uduwrehb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:28:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=bedaaab9-85ae-4a82-86ee-77b70f255a29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1142413850-network", "vif_mac": "fa:16:3e:13:06:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1142413850-network", "vif_mac": "fa:16:3e:13:06:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=70a42471-c66d-4646-83d8-478087cf397f,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a42471-c6') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:28:32 user nova-compute[75285]:   <uuid>bedaaab9-85ae-4a82-86ee-77b70f255a29</uuid>
Nov 10 21:28:32 user nova-compute[75285]:   <name>instance-00000026</name>
Nov 10 21:28:32 user nova-compute[75285]:   <memory>2097152</memory>
Nov 10 21:28:32 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:28:32 user nova-compute[75285]:   <metadata>
Nov 10 21:28:32 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:28:32 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:28:32 user nova-compute[75285]:       <nova:name>tempest-ServerActionsTestOtherA-server-1954355414</nova:name>
Nov 10 21:28:32 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:28:30</nova:creationTime>
Nov 10 21:28:32 user nova-compute[75285]:       <nova:flavor name="m1.small">
Nov 10 21:28:32 user nova-compute[75285]:         <nova:memory>2048</nova:memory>
Nov 10 21:28:32 user nova-compute[75285]:         <nova:disk>20</nova:disk>
Nov 10 21:28:32 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:28:32 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:28:32 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:28:32 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:28:32 user nova-compute[75285]:       <nova:owner>
Nov 10 21:28:32 user nova-compute[75285]:         <nova:user uuid="187d346b3e1b453e8404662727b21a7f">tempest-ServerActionsTestOtherA-1895961867-project-member</nova:user>
Nov 10 21:28:32 user nova-compute[75285]:         <nova:project uuid="e582cea01cf0449fad27fafe0f2d0b4e">tempest-ServerActionsTestOtherA-1895961867</nova:project>
Nov 10 21:28:32 user nova-compute[75285]:       </nova:owner>
Nov 10 21:28:32 user nova-compute[75285]:       <nova:ports>
Nov 10 21:28:32 user nova-compute[75285]:         <nova:port uuid="70a42471-c66d-4646-83d8-478087cf397f">
Nov 10 21:28:32 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 21:28:32 user nova-compute[75285]:         </nova:port>
Nov 10 21:28:32 user nova-compute[75285]:       </nova:ports>
Nov 10 21:28:32 user nova-compute[75285]:     </nova:instance>
Nov 10 21:28:32 user nova-compute[75285]:   </metadata>
Nov 10 21:28:32 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:28:32 user nova-compute[75285]:     <system>
Nov 10 21:28:32 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:28:32 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:28:32 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:28:32 user nova-compute[75285]:       <entry name="serial">bedaaab9-85ae-4a82-86ee-77b70f255a29</entry>
Nov 10 21:28:32 user nova-compute[75285]:       <entry name="uuid">bedaaab9-85ae-4a82-86ee-77b70f255a29</entry>
Nov 10 21:28:32 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:28:32 user nova-compute[75285]:     </system>
Nov 10 21:28:32 user nova-compute[75285]:   </sysinfo>
Nov 10 21:28:32 user nova-compute[75285]:   <os>
Nov 10 21:28:32 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:28:32 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:28:32 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:28:32 user nova-compute[75285]:   </os>
Nov 10 21:28:32 user nova-compute[75285]:   <features>
Nov 10 21:28:32 user nova-compute[75285]:     <acpi/>
Nov 10 21:28:32 user nova-compute[75285]:     <apic/>
Nov 10 21:28:32 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:28:32 user nova-compute[75285]:   </features>
Nov 10 21:28:32 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:28:32 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:28:32 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:28:32 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:28:32 user nova-compute[75285]:   </clock>
Nov 10 21:28:32 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:28:32 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:28:32 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:28:32 user nova-compute[75285]:   </cpu>
Nov 10 21:28:32 user nova-compute[75285]:   <devices>
Nov 10 21:28:32 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:28:32 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:28:32 user nova-compute[75285]:       <source dev="/dev/sdb"/>
Nov 10 21:28:32 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:28:32 user nova-compute[75285]:       <serial>e9d40532-507f-473c-b19f-bbe00cf0bb2c</serial>
Nov 10 21:28:32 user nova-compute[75285]:     </disk>
Nov 10 21:28:32 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:28:32 user nova-compute[75285]:       <mac address="fa:16:3e:13:06:e7"/>
Nov 10 21:28:32 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:28:32 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:28:32 user nova-compute[75285]:       <target dev="tap70a42471-c6"/>
Nov 10 21:28:32 user nova-compute[75285]:     </interface>
Nov 10 21:28:32 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:28:32 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/bedaaab9-85ae-4a82-86ee-77b70f255a29/console.log" append="off"/>
Nov 10 21:28:32 user nova-compute[75285]:     </serial>
Nov 10 21:28:32 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:28:32 user nova-compute[75285]:     <video>
Nov 10 21:28:32 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:28:32 user nova-compute[75285]:     </video>
Nov 10 21:28:32 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:28:32 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:28:32 user nova-compute[75285]:     </rng>
Nov 10 21:28:32 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:28:32 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:28:32 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:28:32 user nova-compute[75285]:     </memballoon>
Nov 10 21:28:32 user nova-compute[75285]:   </devices>
Nov 10 21:28:32 user nova-compute[75285]: </domain>
Nov 10 21:28:32 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1954355414',display_name='tempest-ServerActionsTestOtherA-server-1954355414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1954355414',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNocB749eAh1ht70oz3+10TmA+kLO5gT3lO99nuOm/718owWWR2GClqTfZpHiNdbMnB4WiPNwkXG5KSL2FG22jImExVTOG7tujQLm5tLOPWUZCjIe4jEv2VBcQIF83dwVQ==',key_name='tempest-keypair-1851905805',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:26:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-uduwrehb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:28:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=bedaaab9-85ae-4a82-86ee-77b70f255a29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1142413850-network", "vif_mac": "fa:16:3e:13:06:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1142413850-network", "vif_mac": "fa:16:3e:13:06:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=70a42471-c66d-4646-83d8-478087cf397f,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a42471-c6') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG os_vif [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=70a42471-c66d-4646-83d8-478087cf397f,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a42471-c6') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca1c52b7-d388-56de-8ef3-076ef4f459fe', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70a42471-c6, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70a42471-c6, col_values=(('qos', UUID('3d4d14d2-a5c9-40f7-b624-02a923db7266')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70a42471-c6, col_values=(('external_ids', {'iface-id': '70a42471-c66d-4646-83d8-478087cf397f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:06:e7', 'vm-uuid': 'bedaaab9-85ae-4a82-86ee-77b70f255a29'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:32 user nova-compute[75285]: INFO os_vif [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=70a42471-c66d-4646-83d8-478087cf397f,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a42471-c6')
Nov 10 21:28:32 user nova-compute[75285]: DEBUG nova.compute.manager [req-1dd500e0-b645-4109-9fc2-c349251580db req-197bc642-7478-4054-8b03-42079f177210 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] Received event network-vif-plugged-7f3d9d05-a605-443b-9d66-d14510aefb9a {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1dd500e0-b645-4109-9fc2-c349251580db req-197bc642-7478-4054-8b03-42079f177210 service nova] Acquiring lock "c7933247-e939-4ede-a431-e91488332000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1dd500e0-b645-4109-9fc2-c349251580db req-197bc642-7478-4054-8b03-42079f177210 service nova] Lock "c7933247-e939-4ede-a431-e91488332000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1dd500e0-b645-4109-9fc2-c349251580db req-197bc642-7478-4054-8b03-42079f177210 service nova] Lock "c7933247-e939-4ede-a431-e91488332000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG nova.compute.manager [req-1dd500e0-b645-4109-9fc2-c349251580db req-197bc642-7478-4054-8b03-42079f177210 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] No waiting events found dispatching network-vif-plugged-7f3d9d05-a605-443b-9d66-d14510aefb9a {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:28:32 user nova-compute[75285]: WARNING nova.compute.manager [req-1dd500e0-b645-4109-9fc2-c349251580db req-197bc642-7478-4054-8b03-42079f177210 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] Received unexpected event network-vif-plugged-7f3d9d05-a605-443b-9d66-d14510aefb9a for instance with vm_state deleted and task_state None.
Nov 10 21:28:32 user nova-compute[75285]: DEBUG nova.compute.manager [req-1dd500e0-b645-4109-9fc2-c349251580db req-197bc642-7478-4054-8b03-42079f177210 service nova] [instance: c7933247-e939-4ede-a431-e91488332000] Received event network-vif-deleted-7f3d9d05-a605-443b-9d66-d14510aefb9a {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:28:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] No VIF found with MAC fa:16:3e:13:06:e7, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:28:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-e66c3b09-d1a9-400d-9bb9-cbec840d5faa req-575a41f9-3cd4-439b-a25b-1f048a537d60 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received event network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:28:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e66c3b09-d1a9-400d-9bb9-cbec840d5faa req-575a41f9-3cd4-439b-a25b-1f048a537d60 service nova] Acquiring lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:28:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e66c3b09-d1a9-400d-9bb9-cbec840d5faa req-575a41f9-3cd4-439b-a25b-1f048a537d60 service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:28:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e66c3b09-d1a9-400d-9bb9-cbec840d5faa req-575a41f9-3cd4-439b-a25b-1f048a537d60 service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:28:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-e66c3b09-d1a9-400d-9bb9-cbec840d5faa req-575a41f9-3cd4-439b-a25b-1f048a537d60 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] No waiting events found dispatching network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:28:33 user nova-compute[75285]: WARNING nova.compute.manager [req-e66c3b09-d1a9-400d-9bb9-cbec840d5faa req-575a41f9-3cd4-439b-a25b-1f048a537d60 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received unexpected event network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f for instance with vm_state active and task_state resize_finish.
Nov 10 21:28:35 user nova-compute[75285]: DEBUG nova.compute.manager [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:28:35 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Instance running successfully.
Nov 10 21:28:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Failed to set time: agent not configured {{(pid=75285) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 10 21:28:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-64283b2e-8cbe-4fa6-8004-e74de364375a tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] finish_migration finished successfully. {{(pid=75285) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 10 21:28:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-53cd2376-599c-4f59-8792-d7a5e2ecfc30 req-1772bb00-6cf7-4ddb-bf0c-6d6ee2eee869 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received event network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:28:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-53cd2376-599c-4f59-8792-d7a5e2ecfc30 req-1772bb00-6cf7-4ddb-bf0c-6d6ee2eee869 service nova] Acquiring lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:28:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-53cd2376-599c-4f59-8792-d7a5e2ecfc30 req-1772bb00-6cf7-4ddb-bf0c-6d6ee2eee869 service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:28:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-53cd2376-599c-4f59-8792-d7a5e2ecfc30 req-1772bb00-6cf7-4ddb-bf0c-6d6ee2eee869 service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:28:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-53cd2376-599c-4f59-8792-d7a5e2ecfc30 req-1772bb00-6cf7-4ddb-bf0c-6d6ee2eee869 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] No waiting events found dispatching network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:28:36 user nova-compute[75285]: WARNING nova.compute.manager [req-53cd2376-599c-4f59-8792-d7a5e2ecfc30 req-1772bb00-6cf7-4ddb-bf0c-6d6ee2eee869 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received unexpected event network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f for instance with vm_state resized and task_state None.
Nov 10 21:28:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:28:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:28:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:28:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:28:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:28:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:28:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:28:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:28:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:28:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:28:53 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 21:28:53 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] There are 0 instances to clean {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 21:28:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:28:56 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:28:56 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:28:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:28:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:28:56 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:28:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:57 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updating instance_info_cache with network_info: [{"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:28:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:28:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:28:57 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:28:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:28:57 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:28:58 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:28:58 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:28:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:28:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:28:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:28:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:28:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:28:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:28:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:28:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:28:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:29:01 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:29:01 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=24.998355865478516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Applying migration context for instance bedaaab9-85ae-4a82-86ee-77b70f255a29 as it has an incoming, in-progress migration 67bebab3-f76a-4089-9ac0-5a84a2621d07. Migration status is finished {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 21:29:01 user nova-compute[75285]: INFO nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updating resource usage from migration 67bebab3-f76a-4089-9ac0-5a84a2621d07
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 9114d033-d5c9-45df-a865-78b8a977ffcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Migration 67bebab3-f76a-4089-9ac0-5a84a2621d07 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance bedaaab9-85ae-4a82-86ee-77b70f255a29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing inventories for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating ProviderTree inventory for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating inventory in ProviderTree for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing aggregate associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, aggregates: None {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing trait associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.622s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:29:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:29:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:29:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:29:03 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:29:03 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances with incomplete migration  {{(pid=75285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 21:29:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:08 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_power_states {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 32d2946b-f299-4b62-9f3b-6c00b0b8858b {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid ac0ddf13-9584-4e5d-99be-ad8feb6c532f {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 679abba8-40e6-4489-a34f-d4ae6843387b {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid bedaaab9-85ae-4a82-86ee-77b70f255a29 {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "679abba8-40e6-4489-a34f-d4ae6843387b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "679abba8-40e6-4489-a34f-d4ae6843387b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "bedaaab9-85ae-4a82-86ee-77b70f255a29" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "679abba8-40e6-4489-a34f-d4ae6843387b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:29:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:29:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:29:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:29:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:29:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:20 user nova-compute[75285]: INFO nova.compute.manager [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Terminating instance
Nov 10 21:29:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:29:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG nova.compute.manager [req-90965f44-401c-4e26-b68a-e642658dd81a req-d544af8a-ac6c-4ecb-9259-61292c970019 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-unplugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-90965f44-401c-4e26-b68a-e642658dd81a req-d544af8a-ac6c-4ecb-9259-61292c970019 service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-90965f44-401c-4e26-b68a-e642658dd81a req-d544af8a-ac6c-4ecb-9259-61292c970019 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-90965f44-401c-4e26-b68a-e642658dd81a req-d544af8a-ac6c-4ecb-9259-61292c970019 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG nova.compute.manager [req-90965f44-401c-4e26-b68a-e642658dd81a req-d544af8a-ac6c-4ecb-9259-61292c970019 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-unplugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG nova.compute.manager [req-90965f44-401c-4e26-b68a-e642658dd81a req-d544af8a-ac6c-4ecb-9259-61292c970019 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-unplugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:29:21 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Instance destroyed successfully.
Nov 10 21:29:21 user nova-compute[75285]: DEBUG nova.objects.instance [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'resources' on Instance uuid ac0ddf13-9584-4e5d-99be-ad8feb6c532f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1163902995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1163902995',id=24,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:14:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9957f55c59044088e94338564e04092',ramdisk_id='',reservation_id='r-5x066zft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-396261753',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:16:29Z,user_data=None,user_id='ac13c724170f47368e5a395110c631b7',uuid=ac0ddf13-9584-4e5d-99be-ad8feb6c532f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converting VIF {"id": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "address": "fa:16:3e:6d:a1:72", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6fef20-75", "ovs_interfaceid": "0e6fef20-7528-4441-9e5d-6d81d4fd10a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:a1:72,bridge_name='br-int',has_traffic_filtering=True,id=0e6fef20-7528-4441-9e5d-6d81d4fd10a3,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6fef20-75') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_vif [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:a1:72,bridge_name='br-int',has_traffic_filtering=True,id=0e6fef20-7528-4441-9e5d-6d81d4fd10a3,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6fef20-75') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e6fef20-75, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=771c6070-77e1-4ea1-9c35-d2501e2e2c31) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:29:21 user nova-compute[75285]: INFO os_vif [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:a1:72,bridge_name='br-int',has_traffic_filtering=True,id=0e6fef20-7528-4441-9e5d-6d81d4fd10a3,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6fef20-75')
Nov 10 21:29:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmHUkxpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:29:21 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[677cd740-2f04-487a-84c1-a40786c6084d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:29:21 user nova-compute[75285]: No targets found.
Nov 10 21:29:21 user nova-compute[75285]: iSNS:
Nov 10 21:29:21 user nova-compute[75285]: No targets found.
Nov 10 21:29:21 user nova-compute[75285]: STATIC:
Nov 10 21:29:21 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868
Nov 10 21:29:21 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:29:21 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:29:21 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c
Nov 10 21:29:21 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:29:21 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:29:21 user nova-compute[75285]: FIRMWARE:
Nov 10 21:29:21 user nova-compute[75285]: No targets found.
Nov 10 21:29:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:29:21 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:29:21 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ad7303-77db-4dc7-ae0b-4ca50b5a05cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[913e7991-fa9b-4d25-ae81-16ac6717b8db]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:29:21 user nova-compute[75285]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:29:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 (non-flash)
Nov 10 21:29:21 user nova-compute[75285]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:29:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e45d8670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868'): ({'sdc'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Removing single pathed devices sdc {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[537d6165-fb81-4c90-99c0-a9b2af0e9f5b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[618945a5-de55-494f-94b2-ca9b32199aa1]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Flushing IO for device /dev/sdc {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfbce07-9897-450a-9594-0eb04070153a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[459879d6-96e0-4d62-8cff-f47952198152]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2a67e0-71c1-4927-8aca-0918aa032fe7]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfabdb5-dc63-4faa-aa37-108ffba35b8e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868, portal: 172.16.0.220,3260]
Nov 10 21:29:21 user nova-compute[75285]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868, portal: 172.16.0.220,3260] successful.
Nov 10 21:29:21 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ad68515-50bc-444d-adf3-8552e9192868 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5229e4d6-f323-4680-816a-a09762171049]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] <== disconnect_volume: return (306ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:29:21 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Deleting instance files /opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f_del
Nov 10 21:29:21 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Deletion of /opt/stack/data/nova/instances/ac0ddf13-9584-4e5d-99be-ad8feb6c532f_del complete
Nov 10 21:29:21 user nova-compute[75285]: INFO nova.compute.manager [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 10 21:29:21 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:29:21 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:29:22 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:29:22 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Took 0.84 seconds to deallocate network for instance.
Nov 10 21:29:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-afdf4676-341b-4388-a9bc-5d5e05d93d37 req-ceecc3dd-2c76-46a9-a725-143a7dabe0c5 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-deleted-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:29:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-11a76c6f-13b4-468c-bfcc-1713d4a106c1 req-de81d5dd-e74c-4f9e-82d5-7e68fb430dd5 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:29:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-11a76c6f-13b4-468c-bfcc-1713d4a106c1 req-de81d5dd-e74c-4f9e-82d5-7e68fb430dd5 service nova] Acquiring lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-11a76c6f-13b4-468c-bfcc-1713d4a106c1 req-de81d5dd-e74c-4f9e-82d5-7e68fb430dd5 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-11a76c6f-13b4-468c-bfcc-1713d4a106c1 req-de81d5dd-e74c-4f9e-82d5-7e68fb430dd5 service nova] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-11a76c6f-13b4-468c-bfcc-1713d4a106c1 req-de81d5dd-e74c-4f9e-82d5-7e68fb430dd5 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] No waiting events found dispatching network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:29:23 user nova-compute[75285]: WARNING nova.compute.manager [req-11a76c6f-13b4-468c-bfcc-1713d4a106c1 req-de81d5dd-e74c-4f9e-82d5-7e68fb430dd5 service nova] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Received unexpected event network-vif-plugged-0e6fef20-7528-4441-9e5d-6d81d4fd10a3 for instance with vm_state active and task_state deleting.
Nov 10 21:29:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-0e2287c2-14bd-4031-884d-424fa24a7715 req-3bbcb63c-0ff3-47e4-97eb-2893a0c95d8f service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-changed-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:29:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-0e2287c2-14bd-4031-884d-424fa24a7715 req-3bbcb63c-0ff3-47e4-97eb-2893a0c95d8f service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Refreshing instance network info cache due to event network-changed-a766133d-524b-49ef-95a1-205b134ceeb9. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:29:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0e2287c2-14bd-4031-884d-424fa24a7715 req-3bbcb63c-0ff3-47e4-97eb-2893a0c95d8f service nova] Acquiring lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:29:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0e2287c2-14bd-4031-884d-424fa24a7715 req-3bbcb63c-0ff3-47e4-97eb-2893a0c95d8f service nova] Acquired lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:29:23 user nova-compute[75285]: DEBUG nova.network.neutron [req-0e2287c2-14bd-4031-884d-424fa24a7715 req-3bbcb63c-0ff3-47e4-97eb-2893a0c95d8f service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Refreshing network info cache for port a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:29:23 user nova-compute[75285]: INFO nova.compute.manager [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: ac0ddf13-9584-4e5d-99be-ad8feb6c532f] Took 1.03 seconds to detach 1 volumes for instance.
Nov 10 21:29:23 user nova-compute[75285]: DEBUG nova.network.neutron [req-0e2287c2-14bd-4031-884d-424fa24a7715 req-3bbcb63c-0ff3-47e4-97eb-2893a0c95d8f service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updated VIF entry in instance network info cache for port a766133d-524b-49ef-95a1-205b134ceeb9. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:29:23 user nova-compute[75285]: DEBUG nova.network.neutron [req-0e2287c2-14bd-4031-884d-424fa24a7715 req-3bbcb63c-0ff3-47e4-97eb-2893a0c95d8f service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updating instance_info_cache with network_info: [{"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:29:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0e2287c2-14bd-4031-884d-424fa24a7715 req-3bbcb63c-0ff3-47e4-97eb-2893a0c95d8f service nova] Releasing lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:29:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:24 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:29:24 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:29:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:24 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Deleted allocations for instance ac0ddf13-9584-4e5d-99be-ad8feb6c532f
Nov 10 21:29:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-6e2bb605-47b6-49c3-b0d5-b6e13c354a37 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "ac0ddf13-9584-4e5d-99be-ad8feb6c532f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.571s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'flavor' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:29 user nova-compute[75285]: INFO nova.compute.manager [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Attaching volume 204fc518-9b4a-44d4-bcf9-95c4976bf81f to /dev/vdb
Nov 10 21:29:29 user nova-compute[75285]: DEBUG os_brick.utils [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cd4768-e2b7-46e3-907e-3d3f59040bbe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d299a84-b72a-4aac-a488-da4542807a98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[123c66a0-f58f-494a-9a26-fe43874ad76f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b3d8ad-9ae6-4baa-ab53-ade40cb3c9fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:29:29 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:29:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5ba644-0404-4c55-8ca5-3a8af73a2b72]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG os_brick.utils [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:29:29 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updating existing volume attachment record: 4e6554f8-197f-4600-a428-a14cf333e36a {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:29:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:29:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "bedaaab9-85ae-4a82-86ee-77b70f255a29" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:50 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Going to confirm migration 1 {{(pid=75285) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquired lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lazy-loading 'info_cache' on Instance uuid bedaaab9-85ae-4a82-86ee-77b70f255a29 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updating instance_info_cache with network_info: [{"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Releasing lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lazy-loading 'migration_context' on Instance uuid bedaaab9-85ae-4a82-86ee-77b70f255a29 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG nova.objects.base [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Object Instance<bedaaab9-85ae-4a82-86ee-77b70f255a29> lazy-loaded attributes: info_cache,migration_context {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:29:51 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:29:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.295s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:52 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Deleted allocation for migration 67bebab3-f76a-4089-9ac0-5a84a2621d07
Nov 10 21:29:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2990bd5c-1791-4947-8da7-b20a94b316d0 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.246s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqQXHOWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:29:53 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:29:53 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:29:53 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[334f6dbe-09f1-47f2-8387-ef609f8523d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:29:53 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80432ef-9e5d-4f0e-bdb7-255c74d6b3fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f] added
Nov 10 21:29:53 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f357c3b3-0218-4a39-82a3-4a0e1cc6ba38]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5d8e8f-413f-400d-9d20-7680db7e0394]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqQXHOWV {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqQXHOWV" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[827c2389-36de-472b-ab45-30152883b66a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sqQXHOWV'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc3c7d6-60d5-4e5f-8451-8a3eabe5f6c9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f7a640-ccd7-47dc-bcc6-8e65d5d2215d]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:29:53 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:29:53 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7d743e-4af9-4a94-beb7-c72cad1e523d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260]
Nov 10 21:29:53 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260] successful.
Nov 10 21:29:53 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[28352c77-8a6c-4610-939e-80eb19822661]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83d1633-2ce9-44fb-b3a8-540647eb2200]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:29:53 user nova-compute[75285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:29:53 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:29:53 user nova-compute[75285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:29:53 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c7fe6b-8c93-4576-be08-726a08378477]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:29:53 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:29:54 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:29:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqQXHOWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:29:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:29:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26337396561373631', 'path': '/dev/sdc'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:29:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337396561373631', 'path': '/dev/sdc'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:29:54 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'flavor' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:29:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:29:55 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:29:55 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:29:55 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:29:55 user nova-compute[75285]:   <serial>204fc518-9b4a-44d4-bcf9-95c4976bf81f</serial>
Nov 10 21:29:55 user nova-compute[75285]: </disk>
Nov 10 21:29:55 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:29:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:29:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:29:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] No VIF found with MAC fa:16:3e:1c:34:4b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:29:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3f6997f2-d7d1-4105-9511-a738c3f63344 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.742s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ea8c2f4e-e0aa-4d29-9f4f-fe71f0b8ff28 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ea8c2f4e-e0aa-4d29-9f4f-fe71f0b8ff28 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ea8c2f4e-e0aa-4d29-9f4f-fe71f0b8ff28 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ea8c2f4e-e0aa-4d29-9f4f-fe71f0b8ff28 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75285) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG nova.objects.instance [None req-ea8c2f4e-e0aa-4d29-9f4f-fe71f0b8ff28 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'flavor' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-19cb79fa-5c60-4f6c-8925-bbc1a63c4eb5 req-5bca440f-cc90-44e1-9e0c-38b37b8d9e56 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-vif-unplugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-19cb79fa-5c60-4f6c-8925-bbc1a63c4eb5 req-5bca440f-cc90-44e1-9e0c-38b37b8d9e56 service nova] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-19cb79fa-5c60-4f6c-8925-bbc1a63c4eb5 req-5bca440f-cc90-44e1-9e0c-38b37b8d9e56 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-19cb79fa-5c60-4f6c-8925-bbc1a63c4eb5 req-5bca440f-cc90-44e1-9e0c-38b37b8d9e56 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-19cb79fa-5c60-4f6c-8925-bbc1a63c4eb5 req-5bca440f-cc90-44e1-9e0c-38b37b8d9e56 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] No waiting events found dispatching network-vif-unplugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:29:56 user nova-compute[75285]: WARNING nova.compute.manager [req-19cb79fa-5c60-4f6c-8925-bbc1a63c4eb5 req-5bca440f-cc90-44e1-9e0c-38b37b8d9e56 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received unexpected event network-vif-unplugged-a766133d-524b-49ef-95a1-205b134ceeb9 for instance with vm_state active and task_state powering-off.
Nov 10 21:29:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:29:57 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Instance destroyed successfully.
Nov 10 21:29:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ea8c2f4e-e0aa-4d29-9f4f-fe71f0b8ff28 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:29:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ea8c2f4e-e0aa-4d29-9f4f-fe71f0b8ff28 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.880s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:57 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:29:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:29:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:29:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:29:57 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:29:58 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updating instance_info_cache with network_info: [{"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:29:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:29:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:29:58 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-5316bfa9-bc67-4eb6-9992-15ae2317fefa req-90bef964-d10f-4e95-9744-324fed1aa8e7 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5316bfa9-bc67-4eb6-9992-15ae2317fefa req-90bef964-d10f-4e95-9744-324fed1aa8e7 service nova] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5316bfa9-bc67-4eb6-9992-15ae2317fefa req-90bef964-d10f-4e95-9744-324fed1aa8e7 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5316bfa9-bc67-4eb6-9992-15ae2317fefa req-90bef964-d10f-4e95-9744-324fed1aa8e7 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-5316bfa9-bc67-4eb6-9992-15ae2317fefa req-90bef964-d10f-4e95-9744-324fed1aa8e7 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] No waiting events found dispatching network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:29:59 user nova-compute[75285]: WARNING nova.compute.manager [req-5316bfa9-bc67-4eb6-9992-15ae2317fefa req-90bef964-d10f-4e95-9744-324fed1aa8e7 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received unexpected event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 for instance with vm_state stopped and task_state None.
Nov 10 21:29:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:29:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:30:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:30:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:30:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:30:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:30:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:30:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:30:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:30:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:30:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:30:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:30:01 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:30:01 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:30:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8668MB free_disk=24.979896545410156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:30:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:30:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:30:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:30:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:30:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 9114d033-d5c9-45df-a865-78b8a977ffcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:30:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance bedaaab9-85ae-4a82-86ee-77b70f255a29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:30:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:30:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:30:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:01 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:30:01 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:30:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:30:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:30:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:03 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:30:03 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:30:03 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:30:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:30:11 user nova-compute[75285]: INFO nova.compute.manager [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Terminating instance
Nov 10 21:30:11 user nova-compute[75285]: DEBUG nova.compute.manager [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG nova.compute.manager [req-38673757-5be5-43ec-ad94-1039dedca6e0 req-e20597b3-f575-418a-b8af-aafd8e4b2727 service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Received event network-vif-unplugged-e351ba01-6d16-40ea-ae88-097b9756cc70 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-38673757-5be5-43ec-ad94-1039dedca6e0 req-e20597b3-f575-418a-b8af-aafd8e4b2727 service nova] Acquiring lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-38673757-5be5-43ec-ad94-1039dedca6e0 req-e20597b3-f575-418a-b8af-aafd8e4b2727 service nova] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-38673757-5be5-43ec-ad94-1039dedca6e0 req-e20597b3-f575-418a-b8af-aafd8e4b2727 service nova] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG nova.compute.manager [req-38673757-5be5-43ec-ad94-1039dedca6e0 req-e20597b3-f575-418a-b8af-aafd8e4b2727 service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] No waiting events found dispatching network-vif-unplugged-e351ba01-6d16-40ea-ae88-097b9756cc70 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:30:11 user nova-compute[75285]: DEBUG nova.compute.manager [req-38673757-5be5-43ec-ad94-1039dedca6e0 req-e20597b3-f575-418a-b8af-aafd8e4b2727 service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Received event network-vif-unplugged-e351ba01-6d16-40ea-ae88-097b9756cc70 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:12 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Instance destroyed successfully.
Nov 10 21:30:12 user nova-compute[75285]: DEBUG nova.objects.instance [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lazy-loading 'resources' on Instance uuid 32d2946b-f299-4b62-9f3b-6c00b0b8858b {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:08:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1960528635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1960528635',id=14,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:08:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9957f55c59044088e94338564e04092',ramdisk_id='',reservation_id='r-wc9q91fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-396261753',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:10:51Z,user_data=None,user_id='ac13c724170f47368e5a395110c631b7',uuid=32d2946b-f299-4b62-9f3b-6c00b0b8858b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e351ba01-6d16-40ea-ae88-097b9756cc70", "address": "fa:16:3e:a6:48:80", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape351ba01-6d", "ovs_interfaceid": "e351ba01-6d16-40ea-ae88-097b9756cc70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converting VIF {"id": "e351ba01-6d16-40ea-ae88-097b9756cc70", "address": "fa:16:3e:a6:48:80", "network": {"id": "86d2f389-551b-4a0b-b940-87020156d8f5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-663536205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9957f55c59044088e94338564e04092", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape351ba01-6d", "ovs_interfaceid": "e351ba01-6d16-40ea-ae88-097b9756cc70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e351ba01-6d16-40ea-ae88-097b9756cc70,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape351ba01-6d') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG os_vif [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e351ba01-6d16-40ea-ae88-097b9756cc70,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape351ba01-6d') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape351ba01-6d, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc577e7f-1df2-4449-8f85-15952a77f1c7) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:12 user nova-compute[75285]: INFO os_vif [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:48:80,bridge_name='br-int',has_traffic_filtering=True,id=e351ba01-6d16-40ea-ae88-097b9756cc70,network=Network(86d2f389-551b-4a0b-b940-87020156d8f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape351ba01-6d')
Nov 10 21:30:12 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Deleting instance files /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b_del
Nov 10 21:30:12 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Deletion of /opt/stack/data/nova/instances/32d2946b-f299-4b62-9f3b-6c00b0b8858b_del complete
Nov 10 21:30:12 user nova-compute[75285]: INFO nova.compute.manager [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 10 21:30:12 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:30:12 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:30:13 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:30:13 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Took 0.65 seconds to deallocate network for instance.
Nov 10 21:30:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-db898f9b-c4ff-4082-a377-9eaa8688ec90 req-eba36c7e-cbd4-4b7a-8468-72ce9096294e service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Received event network-vif-deleted-e351ba01-6d16-40ea-ae88-097b9756cc70 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:30:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:30:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:30:13 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:30:13 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:30:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:30:13 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Deleted allocations for instance 32d2946b-f299-4b62-9f3b-6c00b0b8858b
Nov 10 21:30:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7f0def97-47c2-4fc1-8d50-bb17fc865e33 tempest-ServerBootFromVolumeStableRescueTest-396261753 tempest-ServerBootFromVolumeStableRescueTest-396261753-project-member] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.976s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:30:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-d4964e4c-48de-4dfb-ba6f-1a0ebb8f4c95 req-12563a16-d06e-44f2-8a48-e9934830c790 service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Received event network-vif-plugged-e351ba01-6d16-40ea-ae88-097b9756cc70 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:30:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d4964e4c-48de-4dfb-ba6f-1a0ebb8f4c95 req-12563a16-d06e-44f2-8a48-e9934830c790 service nova] Acquiring lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:30:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d4964e4c-48de-4dfb-ba6f-1a0ebb8f4c95 req-12563a16-d06e-44f2-8a48-e9934830c790 service nova] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:30:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d4964e4c-48de-4dfb-ba6f-1a0ebb8f4c95 req-12563a16-d06e-44f2-8a48-e9934830c790 service nova] Lock "32d2946b-f299-4b62-9f3b-6c00b0b8858b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:30:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-d4964e4c-48de-4dfb-ba6f-1a0ebb8f4c95 req-12563a16-d06e-44f2-8a48-e9934830c790 service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] No waiting events found dispatching network-vif-plugged-e351ba01-6d16-40ea-ae88-097b9756cc70 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:30:14 user nova-compute[75285]: WARNING nova.compute.manager [req-d4964e4c-48de-4dfb-ba6f-1a0ebb8f4c95 req-12563a16-d06e-44f2-8a48-e9934830c790 service nova] [instance: 32d2946b-f299-4b62-9f3b-6c00b0b8858b] Received unexpected event network-vif-plugged-e351ba01-6d16-40ea-ae88-097b9756cc70 for instance with vm_state deleted and task_state None.
Nov 10 21:30:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:30:16 user nova-compute[75285]: INFO nova.compute.claims [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Claim successful on node user
Nov 10 21:30:16 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG nova.network.neutron [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:30:16 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:30:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG nova.policy [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56b66f738bb4434db90ccf02355af2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3ef753671474ac5bab59731e0d85f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:30:16 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Creating image(s)
Nov 10 21:30:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "/opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "/opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:30:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.182s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk 1073741824" returned: 0 in 0.056s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.178s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG nova.network.neutron [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Successfully created port: 0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Cannot resize image /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Ensure instance console log exists: /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:30:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.network.neutron [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Successfully updated port: 0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "refresh_cache-7e76d7fe-6e65-40e9-94a1-97b6939caa7e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquired lock "refresh_cache-7e76d7fe-6e65-40e9-94a1-97b6939caa7e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.network.neutron [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.compute.manager [req-bd07783a-9ce2-4f81-a55f-96407c554217 req-0276cf7d-21d5-4dd4-9ccf-4c49d2bfd8a4 service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Received event network-changed-0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.compute.manager [req-bd07783a-9ce2-4f81-a55f-96407c554217 req-0276cf7d-21d5-4dd4-9ccf-4c49d2bfd8a4 service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Refreshing instance network info cache due to event network-changed-0177986a-4885-4fd4-b4e7-ca75bdc97f44. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bd07783a-9ce2-4f81-a55f-96407c554217 req-0276cf7d-21d5-4dd4-9ccf-4c49d2bfd8a4 service nova] Acquiring lock "refresh_cache-7e76d7fe-6e65-40e9-94a1-97b6939caa7e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.network.neutron [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.network.neutron [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Updating instance_info_cache with network_info: [{"id": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "address": "fa:16:3e:6b:a7:c6", "network": {"id": "693e2b7d-0f9b-4eab-8039-151fcaaced24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-455484203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ef753671474ac5bab59731e0d85f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0177986a-48", "ovs_interfaceid": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Releasing lock "refresh_cache-7e76d7fe-6e65-40e9-94a1-97b6939caa7e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.compute.manager [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Instance network_info: |[{"id": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "address": "fa:16:3e:6b:a7:c6", "network": {"id": "693e2b7d-0f9b-4eab-8039-151fcaaced24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-455484203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ef753671474ac5bab59731e0d85f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0177986a-48", "ovs_interfaceid": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bd07783a-9ce2-4f81-a55f-96407c554217 req-0276cf7d-21d5-4dd4-9ccf-4c49d2bfd8a4 service nova] Acquired lock "refresh_cache-7e76d7fe-6e65-40e9-94a1-97b6939caa7e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.network.neutron [req-bd07783a-9ce2-4f81-a55f-96407c554217 req-0276cf7d-21d5-4dd4-9ccf-4c49d2bfd8a4 service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Refreshing network info cache for port 0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Start _get_guest_xml network_info=[{"id": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "address": "fa:16:3e:6b:a7:c6", "network": {"id": "693e2b7d-0f9b-4eab-8039-151fcaaced24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-455484203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ef753671474ac5bab59731e0d85f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0177986a-48", "ovs_interfaceid": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:30:18 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:30:18 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-596812299',display_name='tempest-TestServerVolumeAttachmentScenario-server-596812299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-596812299',id=40,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3j5J5hvB0RNM72Hye9+wiojAZzOrNO3JKUvzI+YFgy9JosDqVVdrU5TTwh2ryzKqRRoCJwQ/sRjXpBjyHrRT3jHb7iMMbAn5PkV3uLUIIBOw0ZvchaZKYzfShdA/7x6A==',key_name='tempest-keypair-1829686459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3ef753671474ac5bab59731e0d85f06',ramdisk_id='',reservation_id='r-aefou0ly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1110515547',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1110515547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:30:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56b66f738bb4434db90ccf02355af2a3',uuid=7e76d7fe-6e65-40e9-94a1-97b6939caa7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "address": "fa:16:3e:6b:a7:c6", "network": {"id": "693e2b7d-0f9b-4eab-8039-151fcaaced24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-455484203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ef753671474ac5bab59731e0d85f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0177986a-48", "ovs_interfaceid": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Converting VIF {"id": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "address": "fa:16:3e:6b:a7:c6", "network": {"id": "693e2b7d-0f9b-4eab-8039-151fcaaced24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-455484203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ef753671474ac5bab59731e0d85f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0177986a-48", "ovs_interfaceid": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a7:c6,bridge_name='br-int',has_traffic_filtering=True,id=0177986a-4885-4fd4-b4e7-ca75bdc97f44,network=Network(693e2b7d-0f9b-4eab-8039-151fcaaced24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0177986a-48') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.objects.instance [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e76d7fe-6e65-40e9-94a1-97b6939caa7e {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:30:18 user nova-compute[75285]:   <uuid>7e76d7fe-6e65-40e9-94a1-97b6939caa7e</uuid>
Nov 10 21:30:18 user nova-compute[75285]:   <name>instance-00000028</name>
Nov 10 21:30:18 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:30:18 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:30:18 user nova-compute[75285]:   <metadata>
Nov 10 21:30:18 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:30:18 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:30:18 user nova-compute[75285]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-596812299</nova:name>
Nov 10 21:30:18 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:30:18</nova:creationTime>
Nov 10 21:30:18 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:30:18 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:30:18 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:30:18 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:30:18 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:30:18 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:30:18 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:30:18 user nova-compute[75285]:       <nova:owner>
Nov 10 21:30:18 user nova-compute[75285]:         <nova:user uuid="56b66f738bb4434db90ccf02355af2a3">tempest-TestServerVolumeAttachmentScenario-1110515547-project-member</nova:user>
Nov 10 21:30:18 user nova-compute[75285]:         <nova:project uuid="c3ef753671474ac5bab59731e0d85f06">tempest-TestServerVolumeAttachmentScenario-1110515547</nova:project>
Nov 10 21:30:18 user nova-compute[75285]:       </nova:owner>
Nov 10 21:30:18 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:30:18 user nova-compute[75285]:       <nova:ports>
Nov 10 21:30:18 user nova-compute[75285]:         <nova:port uuid="0177986a-4885-4fd4-b4e7-ca75bdc97f44">
Nov 10 21:30:18 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 21:30:18 user nova-compute[75285]:         </nova:port>
Nov 10 21:30:18 user nova-compute[75285]:       </nova:ports>
Nov 10 21:30:18 user nova-compute[75285]:     </nova:instance>
Nov 10 21:30:18 user nova-compute[75285]:   </metadata>
Nov 10 21:30:18 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:30:18 user nova-compute[75285]:     <system>
Nov 10 21:30:18 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:30:18 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:30:18 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:30:18 user nova-compute[75285]:       <entry name="serial">7e76d7fe-6e65-40e9-94a1-97b6939caa7e</entry>
Nov 10 21:30:18 user nova-compute[75285]:       <entry name="uuid">7e76d7fe-6e65-40e9-94a1-97b6939caa7e</entry>
Nov 10 21:30:18 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:30:18 user nova-compute[75285]:     </system>
Nov 10 21:30:18 user nova-compute[75285]:   </sysinfo>
Nov 10 21:30:18 user nova-compute[75285]:   <os>
Nov 10 21:30:18 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:30:18 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:30:18 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:30:18 user nova-compute[75285]:   </os>
Nov 10 21:30:18 user nova-compute[75285]:   <features>
Nov 10 21:30:18 user nova-compute[75285]:     <acpi/>
Nov 10 21:30:18 user nova-compute[75285]:     <apic/>
Nov 10 21:30:18 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:30:18 user nova-compute[75285]:   </features>
Nov 10 21:30:18 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:30:18 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:30:18 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:30:18 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:30:18 user nova-compute[75285]:   </clock>
Nov 10 21:30:18 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:30:18 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:30:18 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:30:18 user nova-compute[75285]:   </cpu>
Nov 10 21:30:18 user nova-compute[75285]:   <devices>
Nov 10 21:30:18 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:30:18 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:30:18 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk"/>
Nov 10 21:30:18 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:30:18 user nova-compute[75285]:     </disk>
Nov 10 21:30:18 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:30:18 user nova-compute[75285]:       <mac address="fa:16:3e:6b:a7:c6"/>
Nov 10 21:30:18 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:30:18 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:30:18 user nova-compute[75285]:       <target dev="tap0177986a-48"/>
Nov 10 21:30:18 user nova-compute[75285]:     </interface>
Nov 10 21:30:18 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:30:18 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/console.log" append="off"/>
Nov 10 21:30:18 user nova-compute[75285]:     </serial>
Nov 10 21:30:18 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:30:18 user nova-compute[75285]:     <video>
Nov 10 21:30:18 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:30:18 user nova-compute[75285]:     </video>
Nov 10 21:30:18 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:30:18 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:30:18 user nova-compute[75285]:     </rng>
Nov 10 21:30:18 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:30:18 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:30:18 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:30:18 user nova-compute[75285]:     </memballoon>
Nov 10 21:30:18 user nova-compute[75285]:   </devices>
Nov 10 21:30:18 user nova-compute[75285]: </domain>
Nov 10 21:30:18 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-596812299',display_name='tempest-TestServerVolumeAttachmentScenario-server-596812299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-596812299',id=40,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3j5J5hvB0RNM72Hye9+wiojAZzOrNO3JKUvzI+YFgy9JosDqVVdrU5TTwh2ryzKqRRoCJwQ/sRjXpBjyHrRT3jHb7iMMbAn5PkV3uLUIIBOw0ZvchaZKYzfShdA/7x6A==',key_name='tempest-keypair-1829686459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3ef753671474ac5bab59731e0d85f06',ramdisk_id='',reservation_id='r-aefou0ly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1110515547',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1110515547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:30:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56b66f738bb4434db90ccf02355af2a3',uuid=7e76d7fe-6e65-40e9-94a1-97b6939caa7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "address": "fa:16:3e:6b:a7:c6", "network": {"id": "693e2b7d-0f9b-4eab-8039-151fcaaced24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-455484203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ef753671474ac5bab59731e0d85f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0177986a-48", "ovs_interfaceid": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Converting VIF {"id": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "address": "fa:16:3e:6b:a7:c6", "network": {"id": "693e2b7d-0f9b-4eab-8039-151fcaaced24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-455484203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ef753671474ac5bab59731e0d85f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0177986a-48", "ovs_interfaceid": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a7:c6,bridge_name='br-int',has_traffic_filtering=True,id=0177986a-4885-4fd4-b4e7-ca75bdc97f44,network=Network(693e2b7d-0f9b-4eab-8039-151fcaaced24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0177986a-48') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG os_vif [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a7:c6,bridge_name='br-int',has_traffic_filtering=True,id=0177986a-4885-4fd4-b4e7-ca75bdc97f44,network=Network(693e2b7d-0f9b-4eab-8039-151fcaaced24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0177986a-48') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec3f6972-581f-516f-bf26-d7e195f3903a', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0177986a-48, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0177986a-48, col_values=(('qos', UUID('8547a665-6b9c-469b-8aba-13251663d022')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0177986a-48, col_values=(('external_ids', {'iface-id': '0177986a-4885-4fd4-b4e7-ca75bdc97f44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:a7:c6', 'vm-uuid': '7e76d7fe-6e65-40e9-94a1-97b6939caa7e'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:30:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:18 user nova-compute[75285]: INFO os_vif [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:a7:c6,bridge_name='br-int',has_traffic_filtering=True,id=0177986a-4885-4fd4-b4e7-ca75bdc97f44,network=Network(693e2b7d-0f9b-4eab-8039-151fcaaced24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0177986a-48')
Nov 10 21:30:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:30:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] No VIF found with MAC fa:16:3e:6b:a7:c6, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:30:19 user nova-compute[75285]: DEBUG nova.network.neutron [req-bd07783a-9ce2-4f81-a55f-96407c554217 req-0276cf7d-21d5-4dd4-9ccf-4c49d2bfd8a4 service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Updated VIF entry in instance network info cache for port 0177986a-4885-4fd4-b4e7-ca75bdc97f44. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:30:19 user nova-compute[75285]: DEBUG nova.network.neutron [req-bd07783a-9ce2-4f81-a55f-96407c554217 req-0276cf7d-21d5-4dd4-9ccf-4c49d2bfd8a4 service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Updating instance_info_cache with network_info: [{"id": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "address": "fa:16:3e:6b:a7:c6", "network": {"id": "693e2b7d-0f9b-4eab-8039-151fcaaced24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-455484203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ef753671474ac5bab59731e0d85f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0177986a-48", "ovs_interfaceid": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:30:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bd07783a-9ce2-4f81-a55f-96407c554217 req-0276cf7d-21d5-4dd4-9ccf-4c49d2bfd8a4 service nova] Releasing lock "refresh_cache-7e76d7fe-6e65-40e9-94a1-97b6939caa7e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:30:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:20 user nova-compute[75285]: DEBUG nova.compute.manager [req-a7a81d35-274d-41d0-a395-6c1cfd73924a req-83e22c20-7011-4b3a-aeb5-cde6c0b0f026 service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Received event network-vif-plugged-0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:30:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a7a81d35-274d-41d0-a395-6c1cfd73924a req-83e22c20-7011-4b3a-aeb5-cde6c0b0f026 service nova] Acquiring lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:30:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a7a81d35-274d-41d0-a395-6c1cfd73924a req-83e22c20-7011-4b3a-aeb5-cde6c0b0f026 service nova] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:30:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a7a81d35-274d-41d0-a395-6c1cfd73924a req-83e22c20-7011-4b3a-aeb5-cde6c0b0f026 service nova] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:30:20 user nova-compute[75285]: DEBUG nova.compute.manager [req-a7a81d35-274d-41d0-a395-6c1cfd73924a req-83e22c20-7011-4b3a-aeb5-cde6c0b0f026 service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] No waiting events found dispatching network-vif-plugged-0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:30:20 user nova-compute[75285]: WARNING nova.compute.manager [req-a7a81d35-274d-41d0-a395-6c1cfd73924a req-83e22c20-7011-4b3a-aeb5-cde6c0b0f026 service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Received unexpected event network-vif-plugged-0177986a-4885-4fd4-b4e7-ca75bdc97f44 for instance with vm_state building and task_state spawning.
Nov 10 21:30:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:30:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:30:22 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Instance spawned successfully.
Nov 10 21:30:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:30:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:30:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:30:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:30:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:30:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:30:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:30:22 user nova-compute[75285]: INFO nova.compute.manager [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 10 21:30:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:30:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-70ab3e29-c16b-473c-bf81-47af07a8e921 req-6c7ea669-231f-4ec6-8f94-696f4bd0136b service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Received event network-vif-plugged-0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:30:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-70ab3e29-c16b-473c-bf81-47af07a8e921 req-6c7ea669-231f-4ec6-8f94-696f4bd0136b service nova] Acquiring lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:30:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-70ab3e29-c16b-473c-bf81-47af07a8e921 req-6c7ea669-231f-4ec6-8f94-696f4bd0136b service nova] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:30:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-70ab3e29-c16b-473c-bf81-47af07a8e921 req-6c7ea669-231f-4ec6-8f94-696f4bd0136b service nova] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:30:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-70ab3e29-c16b-473c-bf81-47af07a8e921 req-6c7ea669-231f-4ec6-8f94-696f4bd0136b service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] No waiting events found dispatching network-vif-plugged-0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:30:22 user nova-compute[75285]: WARNING nova.compute.manager [req-70ab3e29-c16b-473c-bf81-47af07a8e921 req-6c7ea669-231f-4ec6-8f94-696f4bd0136b service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Received unexpected event network-vif-plugged-0177986a-4885-4fd4-b4e7-ca75bdc97f44 for instance with vm_state building and task_state spawning.
Nov 10 21:30:22 user nova-compute[75285]: INFO nova.compute.manager [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Took 6.42 seconds to build instance.
Nov 10 21:30:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-78cbd179-5b2f-4c89-987c-67644c345eb9 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.518s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:30:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:30:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:58 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:30:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:30:58 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:30:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:30:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:30:58 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:30:58 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid 679abba8-40e6-4489-a34f-d4ae6843387b {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:30:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:30:59 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updating instance_info_cache with network_info: [{"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:30:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-679abba8-40e6-4489-a34f-d4ae6843387b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:30:59 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:30:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:30:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:30:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:30:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:30:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:30:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:30:59 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:30:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:30:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:30:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:30:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:31:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:01 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:31:01 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:31:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8688MB free_disk=25.074115753173828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:31:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:31:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:31:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:31:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 9114d033-d5c9-45df-a865-78b8a977ffcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:31:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance bedaaab9-85ae-4a82-86ee-77b70f255a29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:31:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:31:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:31:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:31:01 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:31:01 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:31:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:31:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:31:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:31:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:31:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:03 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:31:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:04 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:31:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:05 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:31:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:31:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "419ec5ef-4637-4ee3-8f24-030d21f103d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:31:15 user nova-compute[75285]: INFO nova.compute.claims [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Claim successful on node user
Nov 10 21:31:15 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:31:15 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:31:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG nova.policy [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7762d2ba25d4427ae7ed839e2bbbde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f56b3b4b3e465f97cf07aa338a57a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:31:15 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Creating image(s)
Nov 10 21:31:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "/opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "/opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "/opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:31:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.170s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk 1073741824" returned: 0 in 0.056s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Successfully created port: f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Cannot resize image /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Ensure instance console log exists: /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:31:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Successfully updated port: f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "refresh_cache-419ec5ef-4637-4ee3-8f24-030d21f103d1" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquired lock "refresh_cache-419ec5ef-4637-4ee3-8f24-030d21f103d1" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-a0448b49-2a35-435c-9ed3-74e092ea54d5 req-195ab2c5-380d-4e19-81df-4c00584700df service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Received event network-changed-f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-a0448b49-2a35-435c-9ed3-74e092ea54d5 req-195ab2c5-380d-4e19-81df-4c00584700df service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Refreshing instance network info cache due to event network-changed-f36edebc-6214-47f3-a7aa-e2e8e016e9ff. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a0448b49-2a35-435c-9ed3-74e092ea54d5 req-195ab2c5-380d-4e19-81df-4c00584700df service nova] Acquiring lock "refresh_cache-419ec5ef-4637-4ee3-8f24-030d21f103d1" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Updating instance_info_cache with network_info: [{"id": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "address": "fa:16:3e:8d:cc:f7", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36edebc-62", "ovs_interfaceid": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Releasing lock "refresh_cache-419ec5ef-4637-4ee3-8f24-030d21f103d1" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Instance network_info: |[{"id": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "address": "fa:16:3e:8d:cc:f7", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36edebc-62", "ovs_interfaceid": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a0448b49-2a35-435c-9ed3-74e092ea54d5 req-195ab2c5-380d-4e19-81df-4c00584700df service nova] Acquired lock "refresh_cache-419ec5ef-4637-4ee3-8f24-030d21f103d1" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.network.neutron [req-a0448b49-2a35-435c-9ed3-74e092ea54d5 req-195ab2c5-380d-4e19-81df-4c00584700df service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Refreshing network info cache for port f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Start _get_guest_xml network_info=[{"id": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "address": "fa:16:3e:8d:cc:f7", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36edebc-62", "ovs_interfaceid": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:31:17 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:31:17 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:31:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-60175088',display_name='tempest-AttachVolumeNegativeTest-server-60175088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-60175088',id=41,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnGkbFJODohlwwlJXvj5cF6Me0ixbIbw3g6eCmJDcclujBmFjWy3RaHS40LzjWRUsJ7+ZXxk8oSbtU6mxxs7d4KQ+o/lZfLz5mhcvXEM3Uqf2hRGeyXp2gVv4RqKsdtgQ==',key_name='tempest-keypair-255839765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96f56b3b4b3e465f97cf07aa338a57a9',ramdisk_id='',reservation_id='r-pd1gf0ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-377835946',owner_user_name='tempest-AttachVolumeNegativeTest-377835946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:31:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7762d2ba25d4427ae7ed839e2bbbde4',uuid=419ec5ef-4637-4ee3-8f24-030d21f103d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "address": "fa:16:3e:8d:cc:f7", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36edebc-62", "ovs_interfaceid": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converting VIF {"id": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "address": "fa:16:3e:8d:cc:f7", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36edebc-62", "ovs_interfaceid": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:cc:f7,bridge_name='br-int',has_traffic_filtering=True,id=f36edebc-6214-47f3-a7aa-e2e8e016e9ff,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36edebc-62') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.objects.instance [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lazy-loading 'pci_devices' on Instance uuid 419ec5ef-4637-4ee3-8f24-030d21f103d1 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:31:17 user nova-compute[75285]:   <uuid>419ec5ef-4637-4ee3-8f24-030d21f103d1</uuid>
Nov 10 21:31:17 user nova-compute[75285]:   <name>instance-00000029</name>
Nov 10 21:31:17 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:31:17 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:31:17 user nova-compute[75285]:   <metadata>
Nov 10 21:31:17 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:31:17 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:31:17 user nova-compute[75285]:       <nova:name>tempest-AttachVolumeNegativeTest-server-60175088</nova:name>
Nov 10 21:31:17 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:31:17</nova:creationTime>
Nov 10 21:31:17 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:31:17 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:31:17 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:31:17 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:31:17 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:31:17 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:31:17 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:31:17 user nova-compute[75285]:       <nova:owner>
Nov 10 21:31:17 user nova-compute[75285]:         <nova:user uuid="d7762d2ba25d4427ae7ed839e2bbbde4">tempest-AttachVolumeNegativeTest-377835946-project-member</nova:user>
Nov 10 21:31:17 user nova-compute[75285]:         <nova:project uuid="96f56b3b4b3e465f97cf07aa338a57a9">tempest-AttachVolumeNegativeTest-377835946</nova:project>
Nov 10 21:31:17 user nova-compute[75285]:       </nova:owner>
Nov 10 21:31:17 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:31:17 user nova-compute[75285]:       <nova:ports>
Nov 10 21:31:17 user nova-compute[75285]:         <nova:port uuid="f36edebc-6214-47f3-a7aa-e2e8e016e9ff">
Nov 10 21:31:17 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 21:31:17 user nova-compute[75285]:         </nova:port>
Nov 10 21:31:17 user nova-compute[75285]:       </nova:ports>
Nov 10 21:31:17 user nova-compute[75285]:     </nova:instance>
Nov 10 21:31:17 user nova-compute[75285]:   </metadata>
Nov 10 21:31:17 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:31:17 user nova-compute[75285]:     <system>
Nov 10 21:31:17 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:31:17 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:31:17 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:31:17 user nova-compute[75285]:       <entry name="serial">419ec5ef-4637-4ee3-8f24-030d21f103d1</entry>
Nov 10 21:31:17 user nova-compute[75285]:       <entry name="uuid">419ec5ef-4637-4ee3-8f24-030d21f103d1</entry>
Nov 10 21:31:17 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:31:17 user nova-compute[75285]:     </system>
Nov 10 21:31:17 user nova-compute[75285]:   </sysinfo>
Nov 10 21:31:17 user nova-compute[75285]:   <os>
Nov 10 21:31:17 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:31:17 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:31:17 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:31:17 user nova-compute[75285]:   </os>
Nov 10 21:31:17 user nova-compute[75285]:   <features>
Nov 10 21:31:17 user nova-compute[75285]:     <acpi/>
Nov 10 21:31:17 user nova-compute[75285]:     <apic/>
Nov 10 21:31:17 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:31:17 user nova-compute[75285]:   </features>
Nov 10 21:31:17 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:31:17 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:31:17 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:31:17 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:31:17 user nova-compute[75285]:   </clock>
Nov 10 21:31:17 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:31:17 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:31:17 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:31:17 user nova-compute[75285]:   </cpu>
Nov 10 21:31:17 user nova-compute[75285]:   <devices>
Nov 10 21:31:17 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:31:17 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:31:17 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk"/>
Nov 10 21:31:17 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:31:17 user nova-compute[75285]:     </disk>
Nov 10 21:31:17 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:31:17 user nova-compute[75285]:       <mac address="fa:16:3e:8d:cc:f7"/>
Nov 10 21:31:17 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:31:17 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:31:17 user nova-compute[75285]:       <target dev="tapf36edebc-62"/>
Nov 10 21:31:17 user nova-compute[75285]:     </interface>
Nov 10 21:31:17 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:31:17 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/console.log" append="off"/>
Nov 10 21:31:17 user nova-compute[75285]:     </serial>
Nov 10 21:31:17 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:31:17 user nova-compute[75285]:     <video>
Nov 10 21:31:17 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:31:17 user nova-compute[75285]:     </video>
Nov 10 21:31:17 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:31:17 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:31:17 user nova-compute[75285]:     </rng>
Nov 10 21:31:17 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:31:17 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:31:17 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:31:17 user nova-compute[75285]:     </memballoon>
Nov 10 21:31:17 user nova-compute[75285]:   </devices>
Nov 10 21:31:17 user nova-compute[75285]: </domain>
Nov 10 21:31:17 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:31:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-60175088',display_name='tempest-AttachVolumeNegativeTest-server-60175088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-60175088',id=41,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnGkbFJODohlwwlJXvj5cF6Me0ixbIbw3g6eCmJDcclujBmFjWy3RaHS40LzjWRUsJ7+ZXxk8oSbtU6mxxs7d4KQ+o/lZfLz5mhcvXEM3Uqf2hRGeyXp2gVv4RqKsdtgQ==',key_name='tempest-keypair-255839765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96f56b3b4b3e465f97cf07aa338a57a9',ramdisk_id='',reservation_id='r-pd1gf0ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-377835946',owner_user_name='tempest-AttachVolumeNegativeTest-377835946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:31:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7762d2ba25d4427ae7ed839e2bbbde4',uuid=419ec5ef-4637-4ee3-8f24-030d21f103d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "address": "fa:16:3e:8d:cc:f7", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36edebc-62", "ovs_interfaceid": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converting VIF {"id": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "address": "fa:16:3e:8d:cc:f7", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36edebc-62", "ovs_interfaceid": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:cc:f7,bridge_name='br-int',has_traffic_filtering=True,id=f36edebc-6214-47f3-a7aa-e2e8e016e9ff,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36edebc-62') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG os_vif [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:cc:f7,bridge_name='br-int',has_traffic_filtering=True,id=f36edebc-6214-47f3-a7aa-e2e8e016e9ff,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36edebc-62') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '472a20be-130b-5751-8168-c6c141e3b675', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf36edebc-62, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf36edebc-62, col_values=(('qos', UUID('a8a97ec5-21b7-4948-8918-3af9ab0106e7')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf36edebc-62, col_values=(('external_ids', {'iface-id': 'f36edebc-6214-47f3-a7aa-e2e8e016e9ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:cc:f7', 'vm-uuid': '419ec5ef-4637-4ee3-8f24-030d21f103d1'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:17 user nova-compute[75285]: INFO os_vif [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:cc:f7,bridge_name='br-int',has_traffic_filtering=True,id=f36edebc-6214-47f3-a7aa-e2e8e016e9ff,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36edebc-62')
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:31:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] No VIF found with MAC fa:16:3e:8d:cc:f7, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:31:18 user nova-compute[75285]: DEBUG nova.network.neutron [req-a0448b49-2a35-435c-9ed3-74e092ea54d5 req-195ab2c5-380d-4e19-81df-4c00584700df service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Updated VIF entry in instance network info cache for port f36edebc-6214-47f3-a7aa-e2e8e016e9ff. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:31:18 user nova-compute[75285]: DEBUG nova.network.neutron [req-a0448b49-2a35-435c-9ed3-74e092ea54d5 req-195ab2c5-380d-4e19-81df-4c00584700df service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Updating instance_info_cache with network_info: [{"id": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "address": "fa:16:3e:8d:cc:f7", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36edebc-62", "ovs_interfaceid": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:31:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a0448b49-2a35-435c-9ed3-74e092ea54d5 req-195ab2c5-380d-4e19-81df-4c00584700df service nova] Releasing lock "refresh_cache-419ec5ef-4637-4ee3-8f24-030d21f103d1" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:31:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-0276c50f-cd4b-4ee9-a85d-09985b006d3c req-f5d82d85-96ce-4415-80c3-1196edac78fa service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Received event network-vif-plugged-f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:31:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0276c50f-cd4b-4ee9-a85d-09985b006d3c req-f5d82d85-96ce-4415-80c3-1196edac78fa service nova] Acquiring lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:31:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0276c50f-cd4b-4ee9-a85d-09985b006d3c req-f5d82d85-96ce-4415-80c3-1196edac78fa service nova] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:31:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0276c50f-cd4b-4ee9-a85d-09985b006d3c req-f5d82d85-96ce-4415-80c3-1196edac78fa service nova] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:31:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-0276c50f-cd4b-4ee9-a85d-09985b006d3c req-f5d82d85-96ce-4415-80c3-1196edac78fa service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] No waiting events found dispatching network-vif-plugged-f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:31:19 user nova-compute[75285]: WARNING nova.compute.manager [req-0276c50f-cd4b-4ee9-a85d-09985b006d3c req-f5d82d85-96ce-4415-80c3-1196edac78fa service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Received unexpected event network-vif-plugged-f36edebc-6214-47f3-a7aa-e2e8e016e9ff for instance with vm_state building and task_state spawning.
Nov 10 21:31:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:21 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:31:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:31:21 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Instance spawned successfully.
Nov 10 21:31:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:31:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:31:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:31:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:31:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:31:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:31:21 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:31:21 user nova-compute[75285]: DEBUG nova.compute.manager [req-a2ced37d-047b-445b-b846-3f04f549877e req-ae0e7295-01d8-4630-9bd2-978206963e40 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Received event network-vif-plugged-f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:31:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a2ced37d-047b-445b-b846-3f04f549877e req-ae0e7295-01d8-4630-9bd2-978206963e40 service nova] Acquiring lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:31:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a2ced37d-047b-445b-b846-3f04f549877e req-ae0e7295-01d8-4630-9bd2-978206963e40 service nova] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:31:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-a2ced37d-047b-445b-b846-3f04f549877e req-ae0e7295-01d8-4630-9bd2-978206963e40 service nova] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:31:21 user nova-compute[75285]: DEBUG nova.compute.manager [req-a2ced37d-047b-445b-b846-3f04f549877e req-ae0e7295-01d8-4630-9bd2-978206963e40 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] No waiting events found dispatching network-vif-plugged-f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:31:21 user nova-compute[75285]: WARNING nova.compute.manager [req-a2ced37d-047b-445b-b846-3f04f549877e req-ae0e7295-01d8-4630-9bd2-978206963e40 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Received unexpected event network-vif-plugged-f36edebc-6214-47f3-a7aa-e2e8e016e9ff for instance with vm_state building and task_state spawning.
Nov 10 21:31:21 user nova-compute[75285]: INFO nova.compute.manager [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 10 21:31:21 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:31:21 user nova-compute[75285]: INFO nova.compute.manager [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Took 6.29 seconds to build instance.
Nov 10 21:31:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f8deca31-d50c-4868-8bca-8c07ad06fa00 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.403s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:31:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:41 user nova-compute[75285]: INFO nova.compute.manager [None req-5b1b7199-de15-4aaf-89d7-c1e73ee89390 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Get console output
Nov 10 21:31:41 user nova-compute[75285]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 10 21:31:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:47 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'flavor' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:31:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:31:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquired lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:31:47 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:31:47 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'info_cache' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:31:47 user nova-compute[75285]: DEBUG nova.objects.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Object Instance<9114d033-d5c9-45df-a865-78b8a977ffcc> lazy-loaded attributes: flavor,info_cache {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:31:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updating instance_info_cache with network_info: [{"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Releasing lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:31:48 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Instance destroyed successfully.
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'resources' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.objects.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Object Instance<9114d033-d5c9-45df-a865-78b8a977ffcc> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-525137794',display_name='tempest-AttachVolumeTestJSON-server-525137794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-525137794',id=39,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7CslewLFZpEDkSxi0xOqhMnjfSpBoRGh74QRXv2AvpftFuAfVqDK/0oi/qwx56FgDHg0hXRrn34oXrTuQ0qPKz0m7sH3Nx5In+umv3nh8BqCcmGk4OlTWLjeeWuZhD9Q==',key_name='tempest-keypair-774230573',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='63bf2d92f6524ec0af61667a9f06bc49',ramdisk_id='',reservation_id='r-vbyj8al6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738528264',owner_user_name='tempest-AttachVolumeTestJSON-738528264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:29:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780e11dc70f54bf88772860118930629',uuid=9114d033-d5c9-45df-a865-78b8a977ffcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converting VIF {"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_vif [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa766133d-52, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75156cec-0633-4ab9-a077-d34a1cc404cf) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:31:48 user nova-compute[75285]: INFO os_vif [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52')
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqQXHOWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:31:48 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21d7677-c76c-4781-8244-9b1d9c5c1aa2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:31:48 user nova-compute[75285]: No targets found.
Nov 10 21:31:48 user nova-compute[75285]: iSNS:
Nov 10 21:31:48 user nova-compute[75285]: No targets found.
Nov 10 21:31:48 user nova-compute[75285]: STATIC:
Nov 10 21:31:48 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f
Nov 10 21:31:48 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:31:48 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:31:48 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c
Nov 10 21:31:48 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:31:48 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:31:48 user nova-compute[75285]: FIRMWARE:
Nov 10 21:31:48 user nova-compute[75285]: No targets found.
Nov 10 21:31:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:31:48 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:31:48 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[463653c3-89cf-4bb9-8cb5-7a4a88a69bd7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[62489158-2d07-4155-8502-72a9fa084d69]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:31:48 user nova-compute[75285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:31:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:31:48 user nova-compute[75285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:31:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e45f64d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f'): ({'sdc'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Removing single pathed devices sdc {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcb6820-a845-42ed-9025-342a95f05f08]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d6f95f-d1c8-44c6-bd3e-d03ac3bdbcb8]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Flushing IO for device /dev/sdc {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12f39d3-3144-4f0b-9ff1-f04d94ffb92b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[808584dc-5473-4ff4-a90c-f3142cd07d9e]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79d3489-5c64-48ab-8897-f551e8c7b166]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c355971f-bfff-44e1-8918-d88c8882d310]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260]
Nov 10 21:31:48 user nova-compute[75285]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260] successful.
Nov 10 21:31:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdd2902-87de-48c0-a01e-33adc1f0590b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] <== disconnect_volume: return (271ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Start _get_guest_xml network_info=[{"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '4e6554f8-197f-4600-a428-a14cf333e36a', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqQXHOWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '9114d033-d5c9-45df-a865-78b8a977ffcc', 'attached_at': '', 'detached_at': '', 'volume_id': '204fc518-9b4a-44d4-bcf9-95c4976bf81f', 'serial': '204fc518-9b4a-44d4-bcf9-95c4976bf81f'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'numa_topology' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.objects.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Object Instance<9114d033-d5c9-45df-a865-78b8a977ffcc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:31:48 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:31:48 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.objects.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Object Instance<9114d033-d5c9-45df-a865-78b8a977ffcc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqQXHOWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:31:48 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:31:48 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:31:48 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3459045-d386-4b89-bfcc-2bba0c1d1c13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:31:48 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2389d50-63ca-4d81-9a54-f6aa4ea8662a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f] added
Nov 10 21:31:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f6bbed-e8ad-4537-857d-9bfac175cd1e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5916ffba-96ef-4968-812c-e2451ab693ba]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqQXHOWV {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqQXHOWV" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8f650f-3186-49d6-b6f1-a1749958407a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sqQXHOWV'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc50475-51e6-4c18-85a7-4a58fe574428]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[93eeda83-fd5e-44f7-b9df-3ace083bdb22]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:31:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:31:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba925a05-961e-46fd-9f9d-69ebe24123e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260]
Nov 10 21:31:48 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260] successful.
Nov 10 21:31:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ea7d1-70ef-40a7-8493-ba0485c12e8a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aaba3d-abf6-4f6c-9d7d-97b8e5ddc48b]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:31:48 user nova-compute[75285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:31:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:31:48 user nova-compute[75285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:31:48 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cde5990-f2d0-40a5-b4fb-fc89b24c9ea0]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:31:48 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqQXHOWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:31:49 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:31:49 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26337396561373631', 'path': '/dev/sdc'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:31:49 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337396561373631', 'path': '/dev/sdc'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:31:49 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-525137794',display_name='tempest-AttachVolumeTestJSON-server-525137794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-525137794',id=39,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7CslewLFZpEDkSxi0xOqhMnjfSpBoRGh74QRXv2AvpftFuAfVqDK/0oi/qwx56FgDHg0hXRrn34oXrTuQ0qPKz0m7sH3Nx5In+umv3nh8BqCcmGk4OlTWLjeeWuZhD9Q==',key_name='tempest-keypair-774230573',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='63bf2d92f6524ec0af61667a9f06bc49',ramdisk_id='',reservation_id='r-vbyj8al6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738528264',owner_user_name='tempest-AttachVolumeTestJSON-738528264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:29:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780e11dc70f54bf88772860118930629',uuid=9114d033-d5c9-45df-a865-78b8a977ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:31:49 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converting VIF {"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:31:49 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:31:49 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'pci_devices' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:31:49 user nova-compute[75285]: DEBUG nova.objects.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Object Instance<9114d033-d5c9-45df-a865-78b8a977ffcc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:31:49 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:31:49 user nova-compute[75285]:   <uuid>9114d033-d5c9-45df-a865-78b8a977ffcc</uuid>
Nov 10 21:31:49 user nova-compute[75285]:   <name>instance-00000027</name>
Nov 10 21:31:49 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:31:49 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:31:49 user nova-compute[75285]:   <metadata>
Nov 10 21:31:49 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:31:49 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:31:49 user nova-compute[75285]:       <nova:name>tempest-AttachVolumeTestJSON-server-525137794</nova:name>
Nov 10 21:31:49 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:31:48</nova:creationTime>
Nov 10 21:31:49 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:31:49 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:31:49 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:31:49 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:31:49 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:31:49 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:31:49 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:31:49 user nova-compute[75285]:       <nova:owner>
Nov 10 21:31:49 user nova-compute[75285]:         <nova:user uuid="780e11dc70f54bf88772860118930629">tempest-AttachVolumeTestJSON-738528264-project-member</nova:user>
Nov 10 21:31:49 user nova-compute[75285]:         <nova:project uuid="63bf2d92f6524ec0af61667a9f06bc49">tempest-AttachVolumeTestJSON-738528264</nova:project>
Nov 10 21:31:49 user nova-compute[75285]:       </nova:owner>
Nov 10 21:31:49 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:31:49 user nova-compute[75285]:       <nova:ports>
Nov 10 21:31:49 user nova-compute[75285]:         <nova:port uuid="a766133d-524b-49ef-95a1-205b134ceeb9">
Nov 10 21:31:49 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 21:31:49 user nova-compute[75285]:         </nova:port>
Nov 10 21:31:49 user nova-compute[75285]:       </nova:ports>
Nov 10 21:31:49 user nova-compute[75285]:     </nova:instance>
Nov 10 21:31:49 user nova-compute[75285]:   </metadata>
Nov 10 21:31:49 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:31:49 user nova-compute[75285]:     <system>
Nov 10 21:31:49 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:31:49 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:31:49 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:31:49 user nova-compute[75285]:       <entry name="serial">9114d033-d5c9-45df-a865-78b8a977ffcc</entry>
Nov 10 21:31:49 user nova-compute[75285]:       <entry name="uuid">9114d033-d5c9-45df-a865-78b8a977ffcc</entry>
Nov 10 21:31:49 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:31:49 user nova-compute[75285]:     </system>
Nov 10 21:31:49 user nova-compute[75285]:   </sysinfo>
Nov 10 21:31:49 user nova-compute[75285]:   <os>
Nov 10 21:31:49 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:31:49 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:31:49 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:31:49 user nova-compute[75285]:   </os>
Nov 10 21:31:49 user nova-compute[75285]:   <features>
Nov 10 21:31:49 user nova-compute[75285]:     <acpi/>
Nov 10 21:31:49 user nova-compute[75285]:     <apic/>
Nov 10 21:31:49 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:31:49 user nova-compute[75285]:   </features>
Nov 10 21:31:49 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:31:49 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:31:49 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:31:49 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:31:49 user nova-compute[75285]:   </clock>
Nov 10 21:31:49 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:31:49 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:31:49 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:31:49 user nova-compute[75285]:   </cpu>
Nov 10 21:31:49 user nova-compute[75285]:   <devices>
Nov 10 21:31:49 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:31:49 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:31:49 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk"/>
Nov 10 21:31:49 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:31:49 user nova-compute[75285]:     </disk>
Nov 10 21:31:49 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:31:49 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:31:49 user nova-compute[75285]:       <source dev="/dev/sdc"/>
Nov 10 21:31:49 user nova-compute[75285]:       <target dev="vdb" bus="virtio"/>
Nov 10 21:31:49 user nova-compute[75285]:       <serial>204fc518-9b4a-44d4-bcf9-95c4976bf81f</serial>
Nov 10 21:31:49 user nova-compute[75285]:     </disk>
Nov 10 21:31:49 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:31:49 user nova-compute[75285]:       <mac address="fa:16:3e:1c:34:4b"/>
Nov 10 21:31:49 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:31:49 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:31:49 user nova-compute[75285]:       <target dev="tapa766133d-52"/>
Nov 10 21:31:49 user nova-compute[75285]:     </interface>
Nov 10 21:31:49 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:31:49 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/console.log" append="off"/>
Nov 10 21:31:49 user nova-compute[75285]:     </serial>
Nov 10 21:31:49 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:31:49 user nova-compute[75285]:     <video>
Nov 10 21:31:49 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:31:49 user nova-compute[75285]:     </video>
Nov 10 21:31:49 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:31:49 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:31:49 user nova-compute[75285]:     </rng>
Nov 10 21:31:49 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:31:49 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:31:49 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:31:49 user nova-compute[75285]:     </memballoon>
Nov 10 21:31:49 user nova-compute[75285]:   </devices>
Nov 10 21:31:49 user nova-compute[75285]: </domain>
Nov 10 21:31:49 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:31:49 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG nova.objects.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Object Instance<9114d033-d5c9-45df-a865-78b8a977ffcc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.168s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Cannot resize image /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'migration_context' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG nova.objects.base [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Object Instance<9114d033-d5c9-45df-a865-78b8a977ffcc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-525137794',display_name='tempest-AttachVolumeTestJSON-server-525137794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-525137794',id=39,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7CslewLFZpEDkSxi0xOqhMnjfSpBoRGh74QRXv2AvpftFuAfVqDK/0oi/qwx56FgDHg0hXRrn34oXrTuQ0qPKz0m7sH3Nx5In+umv3nh8BqCcmGk4OlTWLjeeWuZhD9Q==',key_name='tempest-keypair-774230573',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='63bf2d92f6524ec0af61667a9f06bc49',ramdisk_id='',reservation_id='r-vbyj8al6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738528264',owner_user_name='tempest-AttachVolumeTestJSON-738528264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:29:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780e11dc70f54bf88772860118930629',uuid=9114d033-d5c9-45df-a865-78b8a977ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converting VIF {"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG os_vif [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4d378a0-5689-5745-9e6f-002dd9519596', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa766133d-52, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa766133d-52, col_values=(('qos', UUID('3277c1e5-958c-4ff3-8a38-081c70de9a7d')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa766133d-52, col_values=(('external_ids', {'iface-id': 'a766133d-524b-49ef-95a1-205b134ceeb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:34:4b', 'vm-uuid': '9114d033-d5c9-45df-a865-78b8a977ffcc'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:31:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:50 user nova-compute[75285]: INFO os_vif [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52')
Nov 10 21:31:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:52 user nova-compute[75285]: DEBUG nova.compute.manager [req-884f982f-5c62-4900-9931-a6792bfcc74d req-778bc5f2-e0a0-4c32-90cb-c7482e6fe93d service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:31:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-884f982f-5c62-4900-9931-a6792bfcc74d req-778bc5f2-e0a0-4c32-90cb-c7482e6fe93d service nova] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:31:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-884f982f-5c62-4900-9931-a6792bfcc74d req-778bc5f2-e0a0-4c32-90cb-c7482e6fe93d service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:31:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-884f982f-5c62-4900-9931-a6792bfcc74d req-778bc5f2-e0a0-4c32-90cb-c7482e6fe93d service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:31:52 user nova-compute[75285]: DEBUG nova.compute.manager [req-884f982f-5c62-4900-9931-a6792bfcc74d req-778bc5f2-e0a0-4c32-90cb-c7482e6fe93d service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] No waiting events found dispatching network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:31:52 user nova-compute[75285]: WARNING nova.compute.manager [req-884f982f-5c62-4900-9931-a6792bfcc74d req-778bc5f2-e0a0-4c32-90cb-c7482e6fe93d service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received unexpected event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 for instance with vm_state stopped and task_state powering-on.
Nov 10 21:31:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:31:54 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:31:54 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Instance rebooted successfully.
Nov 10 21:31:54 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2d293e70-cfbc-46c4-80c1-bb01e93e58ca tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:31:54 user nova-compute[75285]: DEBUG nova.compute.manager [req-2ec07f06-5678-46ca-ae44-8fabc69e7983 req-13c6229b-145f-47ef-b365-60e0e68ee8c1 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:31:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2ec07f06-5678-46ca-ae44-8fabc69e7983 req-13c6229b-145f-47ef-b365-60e0e68ee8c1 service nova] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:31:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2ec07f06-5678-46ca-ae44-8fabc69e7983 req-13c6229b-145f-47ef-b365-60e0e68ee8c1 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:31:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2ec07f06-5678-46ca-ae44-8fabc69e7983 req-13c6229b-145f-47ef-b365-60e0e68ee8c1 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:31:54 user nova-compute[75285]: DEBUG nova.compute.manager [req-2ec07f06-5678-46ca-ae44-8fabc69e7983 req-13c6229b-145f-47ef-b365-60e0e68ee8c1 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] No waiting events found dispatching network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:31:54 user nova-compute[75285]: WARNING nova.compute.manager [req-2ec07f06-5678-46ca-ae44-8fabc69e7983 req-13c6229b-145f-47ef-b365-60e0e68ee8c1 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received unexpected event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 for instance with vm_state stopped and task_state powering-on.
Nov 10 21:31:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:31:58 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:31:58 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:32:00 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:32:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:32:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:32:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:32:00 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updating instance_info_cache with network_info: [{"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-bedaaab9-85ae-4a82-86ee-77b70f255a29" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:03 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:32:03 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:32:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8405MB free_disk=25.035388946533203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:32:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:32:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:32:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:32:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 9114d033-d5c9-45df-a865-78b8a977ffcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:32:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance bedaaab9-85ae-4a82-86ee-77b70f255a29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:32:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:32:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 419ec5ef-4637-4ee3-8f24-030d21f103d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:32:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:32:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:32:03 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:32:03 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:32:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:32:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:32:04 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:32:04 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:32:05 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:32:05 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:32:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:32:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-e35648f5-83a5-4117-a471-725ec96d1b5a req-246f9cf7-52a1-4acc-9407-5fa21b586c0f service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Received event network-changed-0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-e35648f5-83a5-4117-a471-725ec96d1b5a req-246f9cf7-52a1-4acc-9407-5fa21b586c0f service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Refreshing instance network info cache due to event network-changed-0177986a-4885-4fd4-b4e7-ca75bdc97f44. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e35648f5-83a5-4117-a471-725ec96d1b5a req-246f9cf7-52a1-4acc-9407-5fa21b586c0f service nova] Acquiring lock "refresh_cache-7e76d7fe-6e65-40e9-94a1-97b6939caa7e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e35648f5-83a5-4117-a471-725ec96d1b5a req-246f9cf7-52a1-4acc-9407-5fa21b586c0f service nova] Acquired lock "refresh_cache-7e76d7fe-6e65-40e9-94a1-97b6939caa7e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG nova.network.neutron [req-e35648f5-83a5-4117-a471-725ec96d1b5a req-246f9cf7-52a1-4acc-9407-5fa21b586c0f service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Refreshing network info cache for port 0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG nova.network.neutron [req-e35648f5-83a5-4117-a471-725ec96d1b5a req-246f9cf7-52a1-4acc-9407-5fa21b586c0f service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Updated VIF entry in instance network info cache for port 0177986a-4885-4fd4-b4e7-ca75bdc97f44. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG nova.network.neutron [req-e35648f5-83a5-4117-a471-725ec96d1b5a req-246f9cf7-52a1-4acc-9407-5fa21b586c0f service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Updating instance_info_cache with network_info: [{"id": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "address": "fa:16:3e:6b:a7:c6", "network": {"id": "693e2b7d-0f9b-4eab-8039-151fcaaced24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-455484203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ef753671474ac5bab59731e0d85f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0177986a-48", "ovs_interfaceid": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e35648f5-83a5-4117-a471-725ec96d1b5a req-246f9cf7-52a1-4acc-9407-5fa21b586c0f service nova] Releasing lock "refresh_cache-7e76d7fe-6e65-40e9-94a1-97b6939caa7e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG nova.objects.instance [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lazy-loading 'flavor' on Instance uuid 7e76d7fe-6e65-40e9-94a1-97b6939caa7e {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:32:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:32:07 user nova-compute[75285]: INFO nova.compute.manager [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Attaching volume 5f303420-25af-4afc-8e34-a4cd201d6245 to /dev/vdb
Nov 10 21:32:08 user nova-compute[75285]: DEBUG os_brick.utils [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f316cf-71a6-4310-845c-0af41de7d015]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e26aae-1145-4e7f-bcf0-c24e366c56c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e9ae88-5486-457d-8626-97e38df4a4d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2313796d-d726-420f-92bd-482c5153f315]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:32:08 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:32:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[85435bdd-3017-4b08-bacc-c2a7fe1ce0ee]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG os_brick.utils [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:32:08 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Updating existing volume attachment record: a30e7e34-1585-4bcb-b995-f05774ebe975 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:32:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSONXoPt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:32:31 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:32:31 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:32:31 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[612a3d31-b224-40f0-be2d-af9541858c94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:32:31 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f917be77-b2df-421e-aea8-99f0fdfc9026]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245] added
Nov 10 21:32:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[91660ea4-610a-4aed-ad2f-25e30eb2fc54]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b54ef4-09a6-44d6-849c-1aa34a8e2793]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DSONXoPt {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DSONXoPt" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51fc008-62d9-45ef-bab6-850b33e74dd4]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DSONXoPt'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[560e22b5-ec08-44c3-a985-2d87ab1db3c9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[21504fa6-f96b-4962-9be7-13293f1638bd]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:32:31 user nova-compute[75285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:32:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:32:31 user nova-compute[75285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:32:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6b34b9-37cc-4e23-b60e-d3db2128224b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245, portal: 172.16.0.220,3260]
Nov 10 21:32:31 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245, portal: 172.16.0.220,3260] successful.
Nov 10 21:32:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9aebf9-35be-4aa6-b7bb-d2f335fc9178]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fb4a8e-fd52-499c-b438-688eb002b1c2]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:32:31 user nova-compute[75285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:32:31 user nova-compute[75285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)
Nov 10 21:32:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:32:31 user nova-compute[75285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:32:31 user nova-compute[75285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)
Nov 10 21:32:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b637eec3-0c02-4357-8e45-551aa392a4cb]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:32:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSONXoPt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:32:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:32:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23534386665306237', 'path': '/dev/sdd'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:32:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534386665306237', 'path': '/dev/sdd'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:32:33 user nova-compute[75285]: DEBUG nova.objects.instance [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lazy-loading 'flavor' on Instance uuid 7e76d7fe-6e65-40e9-94a1-97b6939caa7e {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:32:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:32:33 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:32:33 user nova-compute[75285]:   <source dev="/dev/sdd"/>
Nov 10 21:32:33 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:32:33 user nova-compute[75285]:   <serial>5f303420-25af-4afc-8e34-a4cd201d6245</serial>
Nov 10 21:32:33 user nova-compute[75285]: </disk>
Nov 10 21:32:33 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:32:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:32:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:32:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] No VIF found with MAC fa:16:3e:6b:a7:c6, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:32:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d0785eef-64b1-40ca-ba1b-2f42d59d1e6f tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.641s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:32:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:32:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:32:37 user nova-compute[75285]: DEBUG nova.objects.instance [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lazy-loading 'flavor' on Instance uuid 7e76d7fe-6e65-40e9-94a1-97b6939caa7e {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:32:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:32:38 user nova-compute[75285]: INFO nova.compute.manager [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Attaching volume fb9e01c6-5096-453e-9923-e8fea953891b to /dev/vdc
Nov 10 21:32:38 user nova-compute[75285]: DEBUG os_brick.utils [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1f452b-35c2-4926-8afb-7f9853600108]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faf19b5-f485-4e7b-a5df-744b1e1a3a13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[282f0be4-2fc4-4afc-a83a-6abd6927da31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4c51b6-67b4-4d38-b734-61a03d2129a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:32:38 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:32:38 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[497dd083-082b-4bd3-b645-5a07ed2df8b3]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG os_brick.utils [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:32:38 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Updating existing volume attachment record: f30f78a4-0332-4b93-82b8-4f44582cd120 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:32:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "bedaaab9-85ae-4a82-86ee-77b70f255a29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:32:42 user nova-compute[75285]: INFO nova.compute.manager [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Terminating instance
Nov 10 21:32:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG nova.compute.manager [req-7862e5f2-e281-42d5-847f-9627b8e41426 req-3847233e-cd0e-4efa-b622-3f338be73650 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received event network-vif-unplugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7862e5f2-e281-42d5-847f-9627b8e41426 req-3847233e-cd0e-4efa-b622-3f338be73650 service nova] Acquiring lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7862e5f2-e281-42d5-847f-9627b8e41426 req-3847233e-cd0e-4efa-b622-3f338be73650 service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7862e5f2-e281-42d5-847f-9627b8e41426 req-3847233e-cd0e-4efa-b622-3f338be73650 service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG nova.compute.manager [req-7862e5f2-e281-42d5-847f-9627b8e41426 req-3847233e-cd0e-4efa-b622-3f338be73650 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] No waiting events found dispatching network-vif-unplugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG nova.compute.manager [req-7862e5f2-e281-42d5-847f-9627b8e41426 req-3847233e-cd0e-4efa-b622-3f338be73650 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received event network-vif-unplugged-70a42471-c66d-4646-83d8-478087cf397f for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:43 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Instance destroyed successfully.
Nov 10 21:32:43 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lazy-loading 'resources' on Instance uuid bedaaab9-85ae-4a82-86ee-77b70f255a29 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1954355414',display_name='tempest-ServerActionsTestOtherA-server-1954355414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1954355414',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNocB749eAh1ht70oz3+10TmA+kLO5gT3lO99nuOm/718owWWR2GClqTfZpHiNdbMnB4WiPNwkXG5KSL2FG22jImExVTOG7tujQLm5tLOPWUZCjIe4jEv2VBcQIF83dwVQ==',key_name='tempest-keypair-1851905805',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:28:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-uduwrehb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=bedaaab9-85ae-4a82-86ee-77b70f255a29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "70a42471-c66d-4646-83d8-478087cf397f", "address": "fa:16:3e:13:06:e7", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70a42471-c6", "ovs_interfaceid": "70a42471-c66d-4646-83d8-478087cf397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=70a42471-c66d-4646-83d8-478087cf397f,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a42471-c6') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_vif [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=70a42471-c66d-4646-83d8-478087cf397f,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a42471-c6') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70a42471-c6, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d4d14d2-a5c9-40f7-b624-02a923db7266) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:32:43 user nova-compute[75285]: INFO os_vif [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:06:e7,bridge_name='br-int',has_traffic_filtering=True,id=70a42471-c66d-4646-83d8-478087cf397f,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70a42471-c6')
Nov 10 21:32:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UhbTZOEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:32:43 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfa06b1-1a17-4056-b3a5-8828ab3634eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:32:43 user nova-compute[75285]: No targets found.
Nov 10 21:32:43 user nova-compute[75285]: iSNS:
Nov 10 21:32:43 user nova-compute[75285]: No targets found.
Nov 10 21:32:43 user nova-compute[75285]: STATIC:
Nov 10 21:32:43 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245
Nov 10 21:32:43 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:32:43 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:32:43 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f
Nov 10 21:32:43 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:32:43 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:32:43 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c
Nov 10 21:32:43 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:32:43 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:32:43 user nova-compute[75285]: FIRMWARE:
Nov 10 21:32:43 user nova-compute[75285]: No targets found.
Nov 10 21:32:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:32:43 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:32:43 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6556d64c-53af-45a9-ac6d-a9e65d38f5ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba353986-91b4-4ba8-8798-ea8eb8b0e949]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:32:43 user nova-compute[75285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:32:43 user nova-compute[75285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)
Nov 10 21:32:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c (non-flash)
Nov 10 21:32:43 user nova-compute[75285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:32:43 user nova-compute[75285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)
Nov 10 21:32:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e4502560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[521124b5-89e4-4e28-88c0-9a52dd2c6f38]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef48640c-3364-4450-9405-6259a596dea7]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f2531a-9621-46d4-9a52-9d624e7aa5d9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b380ec-4b9d-4038-8d9f-e2a33af4dbc0]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[278b6d74-dc57-48bf-b8fc-024c57d3a21f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ac296d-19fc-497a-a76f-ee75aa2bff34]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260]
Nov 10 21:32:43 user nova-compute[75285]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c, portal: 172.16.0.220,3260] successful.
Nov 10 21:32:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9d40532-507f-473c-b19f-bbe00cf0bb2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d471a4b-55e1-4d1f-81c7-655960bbf38e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] <== disconnect_volume: return (320ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:32:43 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Deleting instance files /opt/stack/data/nova/instances/bedaaab9-85ae-4a82-86ee-77b70f255a29_del
Nov 10 21:32:43 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Deletion of /opt/stack/data/nova/instances/bedaaab9-85ae-4a82-86ee-77b70f255a29_del complete
Nov 10 21:32:43 user nova-compute[75285]: INFO nova.compute.manager [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 10 21:32:43 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:32:43 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:32:44 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:32:44 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Took 0.79 seconds to deallocate network for instance.
Nov 10 21:32:44 user nova-compute[75285]: DEBUG nova.compute.manager [req-c6f2856c-272f-443a-8e25-95e91df4b6af req-e6cc224e-25a2-46eb-9313-f13177057602 service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received event network-vif-deleted-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:32:44 user nova-compute[75285]: DEBUG nova.compute.manager [req-334c5378-9dc6-4d03-95b3-28d9a7190038 req-74f57723-3d99-4348-9086-7605550496ea service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received event network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:32:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-334c5378-9dc6-4d03-95b3-28d9a7190038 req-74f57723-3d99-4348-9086-7605550496ea service nova] Acquiring lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:32:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-334c5378-9dc6-4d03-95b3-28d9a7190038 req-74f57723-3d99-4348-9086-7605550496ea service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:32:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-334c5378-9dc6-4d03-95b3-28d9a7190038 req-74f57723-3d99-4348-9086-7605550496ea service nova] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:32:44 user nova-compute[75285]: DEBUG nova.compute.manager [req-334c5378-9dc6-4d03-95b3-28d9a7190038 req-74f57723-3d99-4348-9086-7605550496ea service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] No waiting events found dispatching network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:32:44 user nova-compute[75285]: WARNING nova.compute.manager [req-334c5378-9dc6-4d03-95b3-28d9a7190038 req-74f57723-3d99-4348-9086-7605550496ea service nova] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Received unexpected event network-vif-plugged-70a42471-c66d-4646-83d8-478087cf397f for instance with vm_state active and task_state deleting.
Nov 10 21:32:45 user nova-compute[75285]: INFO nova.compute.manager [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Took 1.02 seconds to detach 1 volumes for instance.
Nov 10 21:32:45 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: bedaaab9-85ae-4a82-86ee-77b70f255a29] Deleting volume: e9d40532-507f-473c-b19f-bbe00cf0bb2c {{(pid=75285) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 21:32:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:32:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:32:45 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:32:45 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:32:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:32:45 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Deleted allocations for instance bedaaab9-85ae-4a82-86ee-77b70f255a29
Nov 10 21:32:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c178c079-4b7b-4ea5-81aa-aea69cc2efae tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "bedaaab9-85ae-4a82-86ee-77b70f255a29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.523s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:32:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:32:53 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:32:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:32:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:32:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:32:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:32:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:32:58 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:33:00 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:33:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:33:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:33:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:33:00 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updating instance_info_cache with network_info: [{"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:33:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OXDJNECU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:33:02 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:33:02 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:33:02 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc7ae47-81a6-466f-b322-d8c44dc7ab25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:33:02 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9e00b2-f4f0-43ed-8b4b-0e5717552ba5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b] added
Nov 10 21:33:02 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3123d2f-cf78-4704-9a52-92f409c530b5]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a40c64-71a8-4afa-b553-39bccd296ee7]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OXDJNECU {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OXDJNECU" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f5103d-f913-4602-8d56-7ba64235bde9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OXDJNECU'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0295bb1-160a-40cc-8ff7-ddae49d4809a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[11847c81-9c9d-4814-955f-777546adf2e8]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:33:02 user nova-compute[75285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)
Nov 10 21:33:02 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:33:02 user nova-compute[75285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)
Nov 10 21:33:02 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[07082039-9cfa-4eec-8bda-bab7fca53ed6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b, portal: 172.16.0.220,3260]
Nov 10 21:33:02 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b, portal: 172.16.0.220,3260] successful.
Nov 10 21:33:02 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[612b77c0-6cce-4190-b27e-73a07914a11c]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24c5521-99fb-4831-8184-f29a991c4f5a]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:33:02 user nova-compute[75285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)
Nov 10 21:33:02 user nova-compute[75285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b (non-flash)
Nov 10 21:33:02 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:33:02 user nova-compute[75285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)
Nov 10 21:33:02 user nova-compute[75285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b (non-flash)
Nov 10 21:33:02 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b986a9-b5be-4af2-86b4-ab2ed2a076f8]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OXDJNECU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:03 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:33:03 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8589MB free_disk=25.033260345458984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23837303435306530', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837303435306530', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.objects.instance [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lazy-loading 'flavor' on Instance uuid 7e76d7fe-6e65-40e9-94a1-97b6939caa7e {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:33:03 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:33:03 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:33:03 user nova-compute[75285]:   <target dev="vdc" bus="virtio"/>
Nov 10 21:33:03 user nova-compute[75285]:   <serial>fb9e01c6-5096-453e-9923-e8fea953891b</serial>
Nov 10 21:33:03 user nova-compute[75285]: </disk>
Nov 10 21:33:03 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 679abba8-40e6-4489-a34f-d4ae6843387b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 9114d033-d5c9-45df-a865-78b8a977ffcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 419ec5ef-4637-4ee3-8f24-030d21f103d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:33:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] No VIF found with MAC fa:16:3e:6b:a7:c6, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:33:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b4c9c76b-b210-425c-be1f-33cb6d4333ed tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.061s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:33:04 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:33:04 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:33:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:33:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:33:05 user nova-compute[75285]: INFO nova.compute.manager [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Detaching volume fb9e01c6-5096-453e-9923-e8fea953891b
Nov 10 21:33:05 user nova-compute[75285]: INFO nova.virt.block_device [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Attempting to driver detach volume fb9e01c6-5096-453e-9923-e8fea953891b from mountpoint /dev/vdc
Nov 10 21:33:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Attempting to detach device vdc from instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:33:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:33:05 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:33:05 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:33:05 user nova-compute[75285]:   <target dev="vdc" bus="virtio"/>
Nov 10 21:33:05 user nova-compute[75285]:   <serial>fb9e01c6-5096-453e-9923-e8fea953891b</serial>
Nov 10 21:33:05 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 21:33:05 user nova-compute[75285]: </disk>
Nov 10 21:33:05 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:33:05 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Successfully detached device vdc from instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e from the persistent domain config.
Nov 10 21:33:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:33:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:33:05 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:33:05 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:33:05 user nova-compute[75285]:   <target dev="vdc" bus="virtio"/>
Nov 10 21:33:05 user nova-compute[75285]:   <serial>fb9e01c6-5096-453e-9923-e8fea953891b</serial>
Nov 10 21:33:05 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 21:33:05 user nova-compute[75285]: </disk>
Nov 10 21:33:05 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:33:05 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:33:05 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:33:05 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:33:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:33:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:33:06 user nova-compute[75285]: DEBUG nova.compute.manager [req-6892d154-8c18-43d5-b68e-72f24bae1f62 req-172cb94f-8590-4682-af07-7a40b11aef51 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Received event network-changed-f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:33:06 user nova-compute[75285]: DEBUG nova.compute.manager [req-6892d154-8c18-43d5-b68e-72f24bae1f62 req-172cb94f-8590-4682-af07-7a40b11aef51 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Refreshing instance network info cache due to event network-changed-f36edebc-6214-47f3-a7aa-e2e8e016e9ff. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:33:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6892d154-8c18-43d5-b68e-72f24bae1f62 req-172cb94f-8590-4682-af07-7a40b11aef51 service nova] Acquiring lock "refresh_cache-419ec5ef-4637-4ee3-8f24-030d21f103d1" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:33:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6892d154-8c18-43d5-b68e-72f24bae1f62 req-172cb94f-8590-4682-af07-7a40b11aef51 service nova] Acquired lock "refresh_cache-419ec5ef-4637-4ee3-8f24-030d21f103d1" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:33:06 user nova-compute[75285]: DEBUG nova.network.neutron [req-6892d154-8c18-43d5-b68e-72f24bae1f62 req-172cb94f-8590-4682-af07-7a40b11aef51 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Refreshing network info cache for port f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:33:06 user nova-compute[75285]: DEBUG nova.network.neutron [req-6892d154-8c18-43d5-b68e-72f24bae1f62 req-172cb94f-8590-4682-af07-7a40b11aef51 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Updated VIF entry in instance network info cache for port f36edebc-6214-47f3-a7aa-e2e8e016e9ff. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:33:06 user nova-compute[75285]: DEBUG nova.network.neutron [req-6892d154-8c18-43d5-b68e-72f24bae1f62 req-172cb94f-8590-4682-af07-7a40b11aef51 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Updating instance_info_cache with network_info: [{"id": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "address": "fa:16:3e:8d:cc:f7", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36edebc-62", "ovs_interfaceid": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:33:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6892d154-8c18-43d5-b68e-72f24bae1f62 req-172cb94f-8590-4682-af07-7a40b11aef51 service nova] Releasing lock "refresh_cache-419ec5ef-4637-4ee3-8f24-030d21f103d1" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:33:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "419ec5ef-4637-4ee3-8f24-030d21f103d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG nova.objects.instance [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lazy-loading 'flavor' on Instance uuid 419ec5ef-4637-4ee3-8f24-030d21f103d1 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "419ec5ef-4637-4ee3-8f24-030d21f103d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:33:12 user nova-compute[75285]: INFO nova.compute.manager [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Attaching volume f341adb8-f836-40e7-83c5-becff705e235 to /dev/vdb
Nov 10 21:33:12 user nova-compute[75285]: DEBUG os_brick.utils [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3724dd-ffb3-4907-aa21-1f8ab76a78a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b5a9d3-e948-4534-868b-1f25a6685f27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[671b4eeb-a6cc-4313-b1a4-ee3421257019]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb0a225-722d-4efb-a412-b21dd7bb5141]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:33:12 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:33:12 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3519e093-f76f-47b6-b125-fe3d799b4a2f]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG os_brick.utils [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:33:12 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Updating existing volume attachment record: 5a9ba466-75c0-4986-94e1-22328fabd62d {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:33:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:25 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e is timed out.
Nov 10 21:33:25 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Successfully detached device vdc from instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e from the live domain config.
Nov 10 21:33:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:33:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OXDJNECU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:33:25 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:33:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:33:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:33:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:25 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf39458-37c0-454e-88ce-b0908c9a1592]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:33:25 user nova-compute[75285]: No targets found.
Nov 10 21:33:25 user nova-compute[75285]: iSNS:
Nov 10 21:33:25 user nova-compute[75285]: No targets found.
Nov 10 21:33:25 user nova-compute[75285]: STATIC:
Nov 10 21:33:25 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b
Nov 10 21:33:25 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:33:25 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:33:25 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245
Nov 10 21:33:25 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:33:25 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:33:25 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f
Nov 10 21:33:25 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:33:25 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:33:25 user nova-compute[75285]: FIRMWARE:
Nov 10 21:33:25 user nova-compute[75285]: No targets found.
Nov 10 21:33:25 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:33:26 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:33:26 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4393fb8f-fd00-48ac-b285-ab58d5125fa3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[32de05b3-0408-4bb9-9403-221a43a7ae20]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:33:26 user nova-compute[75285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)
Nov 10 21:33:26 user nova-compute[75285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b (non-flash)
Nov 10 21:33:26 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:33:26 user nova-compute[75285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)
Nov 10 21:33:26 user nova-compute[75285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b (non-flash)
Nov 10 21:33:26 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e45704c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[924b65b1-8daf-4971-8db3-41efe496da4a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8646ae07-ad8b-461c-acf9-7e310ef29d26]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8114967e-4435-43f2-a05b-4e718b200f4e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1a8930-8f92-41ae-b908-26171582720e]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[43898c11-4878-4f39-be46-4e6cd699028b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb5b0de-2d32-4b54-892d-89586f3039f3]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b, portal: 172.16.0.220,3260]
Nov 10 21:33:26 user nova-compute[75285]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b, portal: 172.16.0.220,3260] successful.
Nov 10 21:33:26 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9e01c6-5096-453e-9923-e8fea953891b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0ae762-b8e3-47c6-a083-4f1fb95d70e5]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] <== disconnect_volume: return (295ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:33:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:33:27 user nova-compute[75285]: DEBUG nova.objects.instance [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lazy-loading 'flavor' on Instance uuid 7e76d7fe-6e65-40e9-94a1-97b6939caa7e {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:33:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-eb6b3254-6385-4c67-ad27-ebe0dace621b tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.958s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.volume.cinder [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Update attachment failed for attachment 5a9ba466-75c0-4986-94e1-22328fabd62d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c1bb3a12-bae5-44bd-b4d1-5f8be7a9e2c1) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c1bb3a12-bae5-44bd-b4d1-5f8be7a9e2c1)
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Failed to attach f341adb8-f836-40e7-83c5-becff705e235 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c1bb3a12-bae5-44bd-b4d1-5f8be7a9e2c1)
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Traceback (most recent call last):
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     self._do_attach(context, instance, volume, volume_api,
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     self._volume_attach(context, volume, connector, instance,
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     connection_info = volume_api.attachment_update(
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     res = method(self, ctx, *args, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     with excutils.save_and_reraise_exception():
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     self.force_reraise()
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     raise self.value
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     return method.func(obj, *args, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     resp = self._update('/attachments/%s' % id, body)
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     return self.request(url, method, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1]     raise exceptions.from_response(resp, body)
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c1bb3a12-bae5-44bd-b4d1-5f8be7a9e2c1)
Nov 10 21:33:27 user nova-compute[75285]: ERROR nova.compute.manager [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] 
Nov 10 21:33:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.039s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server [None req-1bdf461d-aef1-4447-865c-afee06da0b85 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c1bb3a12-bae5-44bd-b4d1-5f8be7a9e2c1)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c1bb3a12-bae5-44bd-b4d1-5f8be7a9e2c1)
Nov 10 21:33:27 user nova-compute[75285]: ERROR oslo_messaging.rpc.server 
Nov 10 21:33:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:33:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:33:38 user nova-compute[75285]: INFO nova.compute.manager [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Detaching volume 204fc518-9b4a-44d4-bcf9-95c4976bf81f
Nov 10 21:33:38 user nova-compute[75285]: INFO nova.virt.block_device [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Attempting to driver detach volume 204fc518-9b4a-44d4-bcf9-95c4976bf81f from mountpoint /dev/vdb
Nov 10 21:33:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Attempting to detach device vdb from instance 9114d033-d5c9-45df-a865-78b8a977ffcc from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:33:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:33:38 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:33:38 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:33:38 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:33:38 user nova-compute[75285]:   <serial>204fc518-9b4a-44d4-bcf9-95c4976bf81f</serial>
Nov 10 21:33:38 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 21:33:38 user nova-compute[75285]: </disk>
Nov 10 21:33:38 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:33:38 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Successfully detached device vdb from instance 9114d033-d5c9-45df-a865-78b8a977ffcc from the persistent domain config.
Nov 10 21:33:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9114d033-d5c9-45df-a865-78b8a977ffcc from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:33:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:33:38 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:33:38 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:33:38 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:33:38 user nova-compute[75285]:   <serial>204fc518-9b4a-44d4-bcf9-95c4976bf81f</serial>
Nov 10 21:33:38 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 21:33:38 user nova-compute[75285]: </disk>
Nov 10 21:33:38 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:33:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:33:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "679abba8-40e6-4489-a34f-d4ae6843387b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:33:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "679abba8-40e6-4489-a34f-d4ae6843387b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:33:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:33:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:33:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:33:44 user nova-compute[75285]: INFO nova.compute.manager [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Terminating instance
Nov 10 21:33:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:33:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-0273aa36-2359-46fa-be42-c143deaa9266 req-5b48f7bc-94a4-44b9-add5-da46d1459248 service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Received event network-vif-unplugged-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0273aa36-2359-46fa-be42-c143deaa9266 req-5b48f7bc-94a4-44b9-add5-da46d1459248 service nova] Acquiring lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0273aa36-2359-46fa-be42-c143deaa9266 req-5b48f7bc-94a4-44b9-add5-da46d1459248 service nova] Lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0273aa36-2359-46fa-be42-c143deaa9266 req-5b48f7bc-94a4-44b9-add5-da46d1459248 service nova] Lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-0273aa36-2359-46fa-be42-c143deaa9266 req-5b48f7bc-94a4-44b9-add5-da46d1459248 service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] No waiting events found dispatching network-vif-unplugged-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-0273aa36-2359-46fa-be42-c143deaa9266 req-5b48f7bc-94a4-44b9-add5-da46d1459248 service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Received event network-vif-unplugged-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:45 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Instance destroyed successfully.
Nov 10 21:33:45 user nova-compute[75285]: DEBUG nova.objects.instance [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lazy-loading 'resources' on Instance uuid 679abba8-40e6-4489-a34f-d4ae6843387b {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1798779813',display_name='tempest-ServerActionsTestOtherA-server-1798779813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1798779813',id=26,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNocB749eAh1ht70oz3+10TmA+kLO5gT3lO99nuOm/718owWWR2GClqTfZpHiNdbMnB4WiPNwkXG5KSL2FG22jImExVTOG7tujQLm5tLOPWUZCjIe4jEv2VBcQIF83dwVQ==',key_name='tempest-keypair-1851905805',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:14:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e582cea01cf0449fad27fafe0f2d0b4e',ramdisk_id='',reservation_id='r-f89lru1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1895961867',owner_user_name='tempest-ServerActionsTestOtherA-1895961867-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:14:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187d346b3e1b453e8404662727b21a7f',uuid=679abba8-40e6-4489-a34f-d4ae6843387b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converting VIF {"id": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "address": "fa:16:3e:62:ef:29", "network": {"id": "158bcbc4-1f7c-4606-bb92-0f3833158422", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1142413850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e582cea01cf0449fad27fafe0f2d0b4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04ef93a-fd", "ovs_interfaceid": "a04ef93a-fdc5-4229-a69a-1b2daf6f5995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:ef:29,bridge_name='br-int',has_traffic_filtering=True,id=a04ef93a-fdc5-4229-a69a-1b2daf6f5995,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04ef93a-fd') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG os_vif [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:ef:29,bridge_name='br-int',has_traffic_filtering=True,id=a04ef93a-fdc5-4229-a69a-1b2daf6f5995,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04ef93a-fd') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa04ef93a-fd, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6aed765-3dcf-4fe6-a9ce-f91d1eec294c) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:45 user nova-compute[75285]: INFO os_vif [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:ef:29,bridge_name='br-int',has_traffic_filtering=True,id=a04ef93a-fdc5-4229-a69a-1b2daf6f5995,network=Network(158bcbc4-1f7c-4606-bb92-0f3833158422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04ef93a-fd')
Nov 10 21:33:45 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Deleting instance files /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b_del
Nov 10 21:33:45 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Deletion of /opt/stack/data/nova/instances/679abba8-40e6-4489-a34f-d4ae6843387b_del complete
Nov 10 21:33:45 user nova-compute[75285]: INFO nova.compute.manager [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 10 21:33:45 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:33:45 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:33:46 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:33:46 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Took 0.45 seconds to deallocate network for instance.
Nov 10 21:33:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:33:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:33:46 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:33:46 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:33:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:33:46 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Deleted allocations for instance 679abba8-40e6-4489-a34f-d4ae6843387b
Nov 10 21:33:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-9ab71b45-4672-4733-a878-cf94f18f3330 tempest-ServerActionsTestOtherA-1895961867 tempest-ServerActionsTestOtherA-1895961867-project-member] Lock "679abba8-40e6-4489-a34f-d4ae6843387b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.777s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:33:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-c314c39f-86fe-4094-829e-28ee500b3e56 req-e7a51d65-af0b-4c22-a65d-9b06a39a55ff service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Received event network-vif-plugged-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:33:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c314c39f-86fe-4094-829e-28ee500b3e56 req-e7a51d65-af0b-4c22-a65d-9b06a39a55ff service nova] Acquiring lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:33:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c314c39f-86fe-4094-829e-28ee500b3e56 req-e7a51d65-af0b-4c22-a65d-9b06a39a55ff service nova] Lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:33:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c314c39f-86fe-4094-829e-28ee500b3e56 req-e7a51d65-af0b-4c22-a65d-9b06a39a55ff service nova] Lock "679abba8-40e6-4489-a34f-d4ae6843387b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:33:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-c314c39f-86fe-4094-829e-28ee500b3e56 req-e7a51d65-af0b-4c22-a65d-9b06a39a55ff service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] No waiting events found dispatching network-vif-plugged-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:33:47 user nova-compute[75285]: WARNING nova.compute.manager [req-c314c39f-86fe-4094-829e-28ee500b3e56 req-e7a51d65-af0b-4c22-a65d-9b06a39a55ff service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Received unexpected event network-vif-plugged-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 for instance with vm_state deleted and task_state None.
Nov 10 21:33:47 user nova-compute[75285]: DEBUG nova.compute.manager [req-c314c39f-86fe-4094-829e-28ee500b3e56 req-e7a51d65-af0b-4c22-a65d-9b06a39a55ff service nova] [instance: 679abba8-40e6-4489-a34f-d4ae6843387b] Received event network-vif-deleted-a04ef93a-fdc5-4229-a69a-1b2daf6f5995 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:33:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:54 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:33:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:33:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:33:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:33:55 user nova-compute[75285]: INFO nova.compute.manager [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Detaching volume 5f303420-25af-4afc-8e34-a4cd201d6245
Nov 10 21:33:55 user nova-compute[75285]: INFO nova.virt.block_device [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Attempting to driver detach volume 5f303420-25af-4afc-8e34-a4cd201d6245 from mountpoint /dev/vdb
Nov 10 21:33:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Attempting to detach device vdb from instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:33:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:33:55 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:33:55 user nova-compute[75285]:   <source dev="/dev/sdd"/>
Nov 10 21:33:55 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:33:55 user nova-compute[75285]:   <serial>5f303420-25af-4afc-8e34-a4cd201d6245</serial>
Nov 10 21:33:55 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:33:55 user nova-compute[75285]: </disk>
Nov 10 21:33:55 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:33:55 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Successfully detached device vdb from instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e from the persistent domain config.
Nov 10 21:33:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:33:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:33:55 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:33:55 user nova-compute[75285]:   <source dev="/dev/sdd"/>
Nov 10 21:33:55 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:33:55 user nova-compute[75285]:   <serial>5f303420-25af-4afc-8e34-a4cd201d6245</serial>
Nov 10 21:33:55 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:33:55 user nova-compute[75285]: </disk>
Nov 10 21:33:55 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:33:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:33:59 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9114d033-d5c9-45df-a865-78b8a977ffcc is timed out.
Nov 10 21:33:59 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Successfully detached device vdb from instance 9114d033-d5c9-45df-a865-78b8a977ffcc from the live domain config.
Nov 10 21:33:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqQXHOWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:33:59 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[effb10bd-9f1c-475b-bdf0-c7efd38cbadc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:33:59 user nova-compute[75285]: No targets found.
Nov 10 21:33:59 user nova-compute[75285]: iSNS:
Nov 10 21:33:59 user nova-compute[75285]: No targets found.
Nov 10 21:33:59 user nova-compute[75285]: STATIC:
Nov 10 21:33:59 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245
Nov 10 21:33:59 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:33:59 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:33:59 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f
Nov 10 21:33:59 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:33:59 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:33:59 user nova-compute[75285]: FIRMWARE:
Nov 10 21:33:59 user nova-compute[75285]: No targets found.
Nov 10 21:33:59 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:33:59 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:33:59 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d146682c-50da-4005-81a3-abb702d6ff61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b780ba-6647-44e1-b7f6-941a82724055]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:33:59 user nova-compute[75285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)
Nov 10 21:33:59 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f (non-flash)
Nov 10 21:33:59 user nova-compute[75285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)
Nov 10 21:33:59 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e45f6680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f'): ({'sdc'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Removing single pathed devices sdc {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeaa781-9ae5-49b5-b702-46c2f8124a93]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88ccc38-47ef-45e8-b8fb-f2ef32de6c85]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Flushing IO for device /dev/sdc {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9719152a-ff0d-458b-ad0b-012650c2da38]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f1451e-5751-4e6a-a1ec-207606074ca8]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] There are 0 instances to clean {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9406ac36-ff71-4619-83bd-8d81db836587]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc0f5b0-d73b-457b-be21-c2f85a4062f4]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260]
Nov 10 21:33:59 user nova-compute[75285]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f, portal: 172.16.0.220,3260] successful.
Nov 10 21:33:59 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204fc518-9b4a-44d4-bcf9-95c4976bf81f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab11cfc-8ba1-4c8a-b223-675025731540]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] <== disconnect_volume: return (293ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:33:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:34:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:00 user nova-compute[75285]: DEBUG nova.objects.instance [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'flavor' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:34:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7d55386f-39ae-4d22-ae26-601955b34925 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.035s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fb82fb31-f77c-4f05-b828-fc611d38ca3e tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fb82fb31-f77c-4f05-b828-fc611d38ca3e tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-fb82fb31-f77c-4f05-b828-fc611d38ca3e tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-fb82fb31-f77c-4f05-b828-fc611d38ca3e tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75285) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG nova.objects.instance [None req-fb82fb31-f77c-4f05-b828-fc611d38ca3e tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'flavor' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG nova.compute.manager [req-efeccd87-d637-4f4b-a13e-95e8cc3e967c req-66cd463f-b11a-45ca-8267-b896a1b6250b service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-vif-unplugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-efeccd87-d637-4f4b-a13e-95e8cc3e967c req-66cd463f-b11a-45ca-8267-b896a1b6250b service nova] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-efeccd87-d637-4f4b-a13e-95e8cc3e967c req-66cd463f-b11a-45ca-8267-b896a1b6250b service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-efeccd87-d637-4f4b-a13e-95e8cc3e967c req-66cd463f-b11a-45ca-8267-b896a1b6250b service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG nova.compute.manager [req-efeccd87-d637-4f4b-a13e-95e8cc3e967c req-66cd463f-b11a-45ca-8267-b896a1b6250b service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] No waiting events found dispatching network-vif-unplugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:34:01 user nova-compute[75285]: WARNING nova.compute.manager [req-efeccd87-d637-4f4b-a13e-95e8cc3e967c req-66cd463f-b11a-45ca-8267-b896a1b6250b service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received unexpected event network-vif-unplugged-a766133d-524b-49ef-95a1-205b134ceeb9 for instance with vm_state active and task_state powering-off.
Nov 10 21:34:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-7e76d7fe-6e65-40e9-94a1-97b6939caa7e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-7e76d7fe-6e65-40e9-94a1-97b6939caa7e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:34:01 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:34:02 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Instance destroyed successfully.
Nov 10 21:34:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-fb82fb31-f77c-4f05-b828-fc611d38ca3e tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:34:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-fb82fb31-f77c-4f05-b828-fc611d38ca3e tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.846s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:34:02 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Updating instance_info_cache with network_info: [{"id": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "address": "fa:16:3e:6b:a7:c6", "network": {"id": "693e2b7d-0f9b-4eab-8039-151fcaaced24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-455484203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ef753671474ac5bab59731e0d85f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0177986a-48", "ovs_interfaceid": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:34:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-7e76d7fe-6e65-40e9-94a1-97b6939caa7e" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:34:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:34:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:34:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:34:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:34:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:34:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:34:02 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:34:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-c03bcdf5-1128-43e3-bd8a-c90428f9cad7 req-d449508e-044f-4fc6-b0aa-c9f8e5cc0711 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:34:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c03bcdf5-1128-43e3-bd8a-c90428f9cad7 req-d449508e-044f-4fc6-b0aa-c9f8e5cc0711 service nova] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:34:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c03bcdf5-1128-43e3-bd8a-c90428f9cad7 req-d449508e-044f-4fc6-b0aa-c9f8e5cc0711 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:34:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c03bcdf5-1128-43e3-bd8a-c90428f9cad7 req-d449508e-044f-4fc6-b0aa-c9f8e5cc0711 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:34:03 user nova-compute[75285]: DEBUG nova.compute.manager [req-c03bcdf5-1128-43e3-bd8a-c90428f9cad7 req-d449508e-044f-4fc6-b0aa-c9f8e5cc0711 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] No waiting events found dispatching network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:34:03 user nova-compute[75285]: WARNING nova.compute.manager [req-c03bcdf5-1128-43e3-bd8a-c90428f9cad7 req-d449508e-044f-4fc6-b0aa-c9f8e5cc0711 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received unexpected event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 for instance with vm_state stopped and task_state None.
Nov 10 21:34:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:04 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:34:04 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:34:04 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.051319122314453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 9114d033-d5c9-45df-a865-78b8a977ffcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 419ec5ef-4637-4ee3-8f24-030d21f103d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing inventories for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating ProviderTree inventory for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating inventory in ProviderTree for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing aggregate associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, aggregates: None {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing trait associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:34:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:34:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:06 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:34:06 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:34:07 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:34:07 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:34:07 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:34:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:11 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:34:13 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:34:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances with incomplete migration  {{(pid=75285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 21:34:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:16 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e is timed out.
Nov 10 21:34:16 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Successfully detached device vdb from instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e from the live domain config.
Nov 10 21:34:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSONXoPt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:34:16 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b85624-d13e-4333-86d8-2f88091e19b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:34:16 user nova-compute[75285]: No targets found.
Nov 10 21:34:16 user nova-compute[75285]: iSNS:
Nov 10 21:34:16 user nova-compute[75285]: No targets found.
Nov 10 21:34:16 user nova-compute[75285]: STATIC:
Nov 10 21:34:16 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245
Nov 10 21:34:16 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:34:16 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:34:16 user nova-compute[75285]: FIRMWARE:
Nov 10 21:34:16 user nova-compute[75285]: No targets found.
Nov 10 21:34:16 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:34:16 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:34:16 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfb21a9-6543-41a2-a1c5-e595f5f8cf9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f638f3f8-1e15-4ada-a10c-5ce40a0a2fea]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)
Nov 10 21:34:16 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 (non-flash)
Nov 10 21:34:16 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e4571cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245'): ({'sdd'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Removing single pathed devices sdd {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6208cc7d-f9f8-479f-8492-711e317b39cd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0d0775-17cd-4d2d-af8b-56409b76f3f6]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Flushing IO for device /dev/sdd {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c094ee-2a53-405b-a49f-4303ca4bab21]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5791c31c-461f-4f7e-9705-39cb52d2ea5e]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] SCSI volumes sdd have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfae1c52-a3c3-42f8-9212-33b65bb74ae1]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3586764d-d701-4ccd-ad6c-44b5ec7534eb]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245, portal: 172.16.0.220,3260]
Nov 10 21:34:16 user nova-compute[75285]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245, portal: 172.16.0.220,3260] successful.
Nov 10 21:34:16 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f303420-25af-4afc-8e34-a4cd201d6245 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7ba58e-99ec-4efa-b7b2-e8053f05119d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] <== disconnect_volume: return (272ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:34:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:34:17 user nova-compute[75285]: DEBUG nova.objects.instance [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lazy-loading 'flavor' on Instance uuid 7e76d7fe-6e65-40e9-94a1-97b6939caa7e {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:34:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b56906e4-5ef5-4246-8e83-6a5ddb967c5a tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.795s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:34:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:34:46 user nova-compute[75285]: INFO nova.compute.manager [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Terminating instance
Nov 10 21:34:46 user nova-compute[75285]: DEBUG nova.compute.manager [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-2efff1e8-e69e-4fb0-a0a4-40c096e36d0a req-24a07ca2-b47e-4a11-8604-d077c8b9217a service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Received event network-vif-unplugged-0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2efff1e8-e69e-4fb0-a0a4-40c096e36d0a req-24a07ca2-b47e-4a11-8604-d077c8b9217a service nova] Acquiring lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2efff1e8-e69e-4fb0-a0a4-40c096e36d0a req-24a07ca2-b47e-4a11-8604-d077c8b9217a service nova] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2efff1e8-e69e-4fb0-a0a4-40c096e36d0a req-24a07ca2-b47e-4a11-8604-d077c8b9217a service nova] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-2efff1e8-e69e-4fb0-a0a4-40c096e36d0a req-24a07ca2-b47e-4a11-8604-d077c8b9217a service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] No waiting events found dispatching network-vif-unplugged-0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:34:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-2efff1e8-e69e-4fb0-a0a4-40c096e36d0a req-24a07ca2-b47e-4a11-8604-d077c8b9217a service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Received event network-vif-unplugged-0177986a-4885-4fd4-b4e7-ca75bdc97f44 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:34:47 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Instance destroyed successfully.
Nov 10 21:34:47 user nova-compute[75285]: DEBUG nova.objects.instance [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lazy-loading 'resources' on Instance uuid 7e76d7fe-6e65-40e9-94a1-97b6939caa7e {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:30:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-596812299',display_name='tempest-TestServerVolumeAttachmentScenario-server-596812299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-596812299',id=40,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3j5J5hvB0RNM72Hye9+wiojAZzOrNO3JKUvzI+YFgy9JosDqVVdrU5TTwh2ryzKqRRoCJwQ/sRjXpBjyHrRT3jHb7iMMbAn5PkV3uLUIIBOw0ZvchaZKYzfShdA/7x6A==',key_name='tempest-keypair-1829686459',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:30:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3ef753671474ac5bab59731e0d85f06',ramdisk_id='',reservation_id='r-aefou0ly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1110515547',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1110515547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:30:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56b66f738bb4434db90ccf02355af2a3',uuid=7e76d7fe-6e65-40e9-94a1-97b6939caa7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "address": "fa:16:3e:6b:a7:c6", "network": {"id": "693e2b7d-0f9b-4eab-8039-151fcaaced24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-455484203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ef753671474ac5bab59731e0d85f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0177986a-48", "ovs_interfaceid": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Converting VIF {"id": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "address": "fa:16:3e:6b:a7:c6", "network": {"id": "693e2b7d-0f9b-4eab-8039-151fcaaced24", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-455484203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3ef753671474ac5bab59731e0d85f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0177986a-48", "ovs_interfaceid": "0177986a-4885-4fd4-b4e7-ca75bdc97f44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:a7:c6,bridge_name='br-int',has_traffic_filtering=True,id=0177986a-4885-4fd4-b4e7-ca75bdc97f44,network=Network(693e2b7d-0f9b-4eab-8039-151fcaaced24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0177986a-48') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG os_vif [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:a7:c6,bridge_name='br-int',has_traffic_filtering=True,id=0177986a-4885-4fd4-b4e7-ca75bdc97f44,network=Network(693e2b7d-0f9b-4eab-8039-151fcaaced24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0177986a-48') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0177986a-48, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8547a665-6b9c-469b-8aba-13251663d022) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:47 user nova-compute[75285]: INFO os_vif [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:a7:c6,bridge_name='br-int',has_traffic_filtering=True,id=0177986a-4885-4fd4-b4e7-ca75bdc97f44,network=Network(693e2b7d-0f9b-4eab-8039-151fcaaced24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0177986a-48')
Nov 10 21:34:47 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Deleting instance files /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e_del
Nov 10 21:34:47 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Deletion of /opt/stack/data/nova/instances/7e76d7fe-6e65-40e9-94a1-97b6939caa7e_del complete
Nov 10 21:34:47 user nova-compute[75285]: INFO nova.compute.manager [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 10 21:34:47 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:34:47 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:34:48 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:34:48 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Took 1.13 seconds to deallocate network for instance.
Nov 10 21:34:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:34:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:34:48 user nova-compute[75285]: DEBUG nova.compute.manager [req-6f6c89be-890b-4361-976d-c46e51b8fbed req-6d9333cd-3be0-47e0-b1d9-f76d892a77e0 service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Received event network-vif-deleted-0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:34:48 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:34:48 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:34:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:34:48 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Deleted allocations for instance 7e76d7fe-6e65-40e9-94a1-97b6939caa7e
Nov 10 21:34:48 user nova-compute[75285]: DEBUG nova.compute.manager [req-627f6a5c-1bef-4b52-a33b-0f001fd9e4e6 req-7b731620-5239-447d-abdf-fc6fa0952b7c service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Received event network-vif-plugged-0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:34:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-627f6a5c-1bef-4b52-a33b-0f001fd9e4e6 req-7b731620-5239-447d-abdf-fc6fa0952b7c service nova] Acquiring lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:34:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-627f6a5c-1bef-4b52-a33b-0f001fd9e4e6 req-7b731620-5239-447d-abdf-fc6fa0952b7c service nova] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:34:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-627f6a5c-1bef-4b52-a33b-0f001fd9e4e6 req-7b731620-5239-447d-abdf-fc6fa0952b7c service nova] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:34:48 user nova-compute[75285]: DEBUG nova.compute.manager [req-627f6a5c-1bef-4b52-a33b-0f001fd9e4e6 req-7b731620-5239-447d-abdf-fc6fa0952b7c service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] No waiting events found dispatching network-vif-plugged-0177986a-4885-4fd4-b4e7-ca75bdc97f44 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:34:48 user nova-compute[75285]: WARNING nova.compute.manager [req-627f6a5c-1bef-4b52-a33b-0f001fd9e4e6 req-7b731620-5239-447d-abdf-fc6fa0952b7c service nova] [instance: 7e76d7fe-6e65-40e9-94a1-97b6939caa7e] Received unexpected event network-vif-plugged-0177986a-4885-4fd4-b4e7-ca75bdc97f44 for instance with vm_state deleted and task_state None.
Nov 10 21:34:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-774c699e-5d48-4466-9046-31e6d758b9c6 tempest-TestServerVolumeAttachmentScenario-1110515547 tempest-TestServerVolumeAttachmentScenario-1110515547-project-member] Lock "7e76d7fe-6e65-40e9-94a1-97b6939caa7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.412s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:34:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:34:54 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:34:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:35:01 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:35:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:35:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:35:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:35:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:35:01 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:35:01 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:35:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:35:02 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updating instance_info_cache with network_info: [{"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:35:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:35:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:35:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:35:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:35:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:35:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:35:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:35:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:35:02 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:35:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:35:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:35:02 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:35:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:35:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:35:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:35:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:35:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:35:03 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:35:03 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:35:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=25.077545166015625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:35:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:35:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:35:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 9114d033-d5c9-45df-a865-78b8a977ffcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:35:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 419ec5ef-4637-4ee3-8f24-030d21f103d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:35:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:35:03 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:35:03 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:35:04 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:35:04 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:35:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:35:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:35:08 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:35:08 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:35:08 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:35:08 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:35:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:35:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:35:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:35:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:35:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:35:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:35:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:35:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:35:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:35:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:35:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:35:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:35:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:35:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:35:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:35:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:35:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:35:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:35:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:35:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'flavor' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquired lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'info_cache' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.objects.base [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Object Instance<9114d033-d5c9-45df-a865-78b8a977ffcc> lazy-loaded attributes: flavor,info_cache {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updating instance_info_cache with network_info: [{"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Releasing lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:35:52 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Instance destroyed successfully.
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'resources' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.objects.base [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Object Instance<9114d033-d5c9-45df-a865-78b8a977ffcc> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-525137794',display_name='tempest-AttachVolumeTestJSON-server-525137794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-525137794',id=39,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7CslewLFZpEDkSxi0xOqhMnjfSpBoRGh74QRXv2AvpftFuAfVqDK/0oi/qwx56FgDHg0hXRrn34oXrTuQ0qPKz0m7sH3Nx5In+umv3nh8BqCcmGk4OlTWLjeeWuZhD9Q==',key_name='tempest-keypair-774230573',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='63bf2d92f6524ec0af61667a9f06bc49',ramdisk_id='',reservation_id='r-vbyj8al6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738528264',owner_user_name='tempest-AttachVolumeTestJSON-738528264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:34:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780e11dc70f54bf88772860118930629',uuid=9114d033-d5c9-45df-a865-78b8a977ffcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converting VIF {"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG os_vif [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa766133d-52, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3277c1e5-958c-4ff3-8a38-081c70de9a7d) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:52 user nova-compute[75285]: INFO os_vif [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52')
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Start _get_guest_xml network_info=[{"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'numa_topology' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.objects.base [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Object Instance<9114d033-d5c9-45df-a865-78b8a977ffcc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:35:52 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:35:52 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.objects.base [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Object Instance<9114d033-d5c9-45df-a865-78b8a977ffcc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-525137794',display_name='tempest-AttachVolumeTestJSON-server-525137794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-525137794',id=39,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7CslewLFZpEDkSxi0xOqhMnjfSpBoRGh74QRXv2AvpftFuAfVqDK/0oi/qwx56FgDHg0hXRrn34oXrTuQ0qPKz0m7sH3Nx5In+umv3nh8BqCcmGk4OlTWLjeeWuZhD9Q==',key_name='tempest-keypair-774230573',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='63bf2d92f6524ec0af61667a9f06bc49',ramdisk_id='',reservation_id='r-vbyj8al6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738528264',owner_user_name='tempest-AttachVolumeTestJSON-738528264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:34:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780e11dc70f54bf88772860118930629',uuid=9114d033-d5c9-45df-a865-78b8a977ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converting VIF {"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'pci_devices' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.objects.base [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Object Instance<9114d033-d5c9-45df-a865-78b8a977ffcc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:35:52 user nova-compute[75285]:   <uuid>9114d033-d5c9-45df-a865-78b8a977ffcc</uuid>
Nov 10 21:35:52 user nova-compute[75285]:   <name>instance-00000027</name>
Nov 10 21:35:52 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:35:52 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:35:52 user nova-compute[75285]:   <metadata>
Nov 10 21:35:52 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:35:52 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:35:52 user nova-compute[75285]:       <nova:name>tempest-AttachVolumeTestJSON-server-525137794</nova:name>
Nov 10 21:35:52 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:35:52</nova:creationTime>
Nov 10 21:35:52 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:35:52 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:35:52 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:35:52 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:35:52 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:35:52 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:35:52 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:35:52 user nova-compute[75285]:       <nova:owner>
Nov 10 21:35:52 user nova-compute[75285]:         <nova:user uuid="780e11dc70f54bf88772860118930629">tempest-AttachVolumeTestJSON-738528264-project-member</nova:user>
Nov 10 21:35:52 user nova-compute[75285]:         <nova:project uuid="63bf2d92f6524ec0af61667a9f06bc49">tempest-AttachVolumeTestJSON-738528264</nova:project>
Nov 10 21:35:52 user nova-compute[75285]:       </nova:owner>
Nov 10 21:35:52 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:35:52 user nova-compute[75285]:       <nova:ports>
Nov 10 21:35:52 user nova-compute[75285]:         <nova:port uuid="a766133d-524b-49ef-95a1-205b134ceeb9">
Nov 10 21:35:52 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 21:35:52 user nova-compute[75285]:         </nova:port>
Nov 10 21:35:52 user nova-compute[75285]:       </nova:ports>
Nov 10 21:35:52 user nova-compute[75285]:     </nova:instance>
Nov 10 21:35:52 user nova-compute[75285]:   </metadata>
Nov 10 21:35:52 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:35:52 user nova-compute[75285]:     <system>
Nov 10 21:35:52 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:35:52 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:35:52 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:35:52 user nova-compute[75285]:       <entry name="serial">9114d033-d5c9-45df-a865-78b8a977ffcc</entry>
Nov 10 21:35:52 user nova-compute[75285]:       <entry name="uuid">9114d033-d5c9-45df-a865-78b8a977ffcc</entry>
Nov 10 21:35:52 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:35:52 user nova-compute[75285]:     </system>
Nov 10 21:35:52 user nova-compute[75285]:   </sysinfo>
Nov 10 21:35:52 user nova-compute[75285]:   <os>
Nov 10 21:35:52 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:35:52 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:35:52 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:35:52 user nova-compute[75285]:   </os>
Nov 10 21:35:52 user nova-compute[75285]:   <features>
Nov 10 21:35:52 user nova-compute[75285]:     <acpi/>
Nov 10 21:35:52 user nova-compute[75285]:     <apic/>
Nov 10 21:35:52 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:35:52 user nova-compute[75285]:   </features>
Nov 10 21:35:52 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:35:52 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:35:52 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:35:52 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:35:52 user nova-compute[75285]:   </clock>
Nov 10 21:35:52 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:35:52 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:35:52 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:35:52 user nova-compute[75285]:   </cpu>
Nov 10 21:35:52 user nova-compute[75285]:   <devices>
Nov 10 21:35:52 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:35:52 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:35:52 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk"/>
Nov 10 21:35:52 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:35:52 user nova-compute[75285]:     </disk>
Nov 10 21:35:52 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:35:52 user nova-compute[75285]:       <mac address="fa:16:3e:1c:34:4b"/>
Nov 10 21:35:52 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:35:52 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:35:52 user nova-compute[75285]:       <target dev="tapa766133d-52"/>
Nov 10 21:35:52 user nova-compute[75285]:     </interface>
Nov 10 21:35:52 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:35:52 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/console.log" append="off"/>
Nov 10 21:35:52 user nova-compute[75285]:     </serial>
Nov 10 21:35:52 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:35:52 user nova-compute[75285]:     <video>
Nov 10 21:35:52 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:35:52 user nova-compute[75285]:     </video>
Nov 10 21:35:52 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:35:52 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:35:52 user nova-compute[75285]:     </rng>
Nov 10 21:35:52 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:35:52 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:35:52 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:35:52 user nova-compute[75285]:     </memballoon>
Nov 10 21:35:52 user nova-compute[75285]:   </devices>
Nov 10 21:35:52 user nova-compute[75285]: </domain>
Nov 10 21:35:52 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:35:52 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG nova.objects.base [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Object Instance<9114d033-d5c9-45df-a865-78b8a977ffcc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.178s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Cannot resize image /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'migration_context' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG nova.objects.base [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Object Instance<9114d033-d5c9-45df-a865-78b8a977ffcc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-525137794',display_name='tempest-AttachVolumeTestJSON-server-525137794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-525137794',id=39,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7CslewLFZpEDkSxi0xOqhMnjfSpBoRGh74QRXv2AvpftFuAfVqDK/0oi/qwx56FgDHg0hXRrn34oXrTuQ0qPKz0m7sH3Nx5In+umv3nh8BqCcmGk4OlTWLjeeWuZhD9Q==',key_name='tempest-keypair-774230573',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='63bf2d92f6524ec0af61667a9f06bc49',ramdisk_id='',reservation_id='r-vbyj8al6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738528264',owner_user_name='tempest-AttachVolumeTestJSON-738528264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:34:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780e11dc70f54bf88772860118930629',uuid=9114d033-d5c9-45df-a865-78b8a977ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converting VIF {"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG os_vif [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4d378a0-5689-5745-9e6f-002dd9519596', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa766133d-52, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa766133d-52, col_values=(('qos', UUID('6ffb07cf-68ce-44b9-9c05-30d6774f8eb6')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa766133d-52, col_values=(('external_ids', {'iface-id': 'a766133d-524b-49ef-95a1-205b134ceeb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:34:4b', 'vm-uuid': '9114d033-d5c9-45df-a865-78b8a977ffcc'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:35:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:53 user nova-compute[75285]: INFO os_vif [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52')
Nov 10 21:35:54 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:35:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:55 user nova-compute[75285]: DEBUG nova.compute.manager [req-153fdd1d-ba01-4090-b630-b1d519e0b28d req-9e7725d6-dc09-4083-8334-c432c3cd7184 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:35:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-153fdd1d-ba01-4090-b630-b1d519e0b28d req-9e7725d6-dc09-4083-8334-c432c3cd7184 service nova] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:35:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-153fdd1d-ba01-4090-b630-b1d519e0b28d req-9e7725d6-dc09-4083-8334-c432c3cd7184 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:35:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-153fdd1d-ba01-4090-b630-b1d519e0b28d req-9e7725d6-dc09-4083-8334-c432c3cd7184 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:35:55 user nova-compute[75285]: DEBUG nova.compute.manager [req-153fdd1d-ba01-4090-b630-b1d519e0b28d req-9e7725d6-dc09-4083-8334-c432c3cd7184 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] No waiting events found dispatching network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:35:55 user nova-compute[75285]: WARNING nova.compute.manager [req-153fdd1d-ba01-4090-b630-b1d519e0b28d req-9e7725d6-dc09-4083-8334-c432c3cd7184 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received unexpected event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 for instance with vm_state stopped and task_state powering-on.
Nov 10 21:35:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:35:57 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Instance rebooted successfully.
Nov 10 21:35:57 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c631b8aa-09d6-4fa3-bed6-cee656ad2aed tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:35:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:35:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-d7458e35-d947-44ab-a58f-e9eaa96dd8e0 req-e113bb37-00d6-4b05-9093-a4602aebcc8e service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:35:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d7458e35-d947-44ab-a58f-e9eaa96dd8e0 req-e113bb37-00d6-4b05-9093-a4602aebcc8e service nova] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:35:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d7458e35-d947-44ab-a58f-e9eaa96dd8e0 req-e113bb37-00d6-4b05-9093-a4602aebcc8e service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:35:57 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d7458e35-d947-44ab-a58f-e9eaa96dd8e0 req-e113bb37-00d6-4b05-9093-a4602aebcc8e service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:35:57 user nova-compute[75285]: DEBUG nova.compute.manager [req-d7458e35-d947-44ab-a58f-e9eaa96dd8e0 req-e113bb37-00d6-4b05-9093-a4602aebcc8e service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] No waiting events found dispatching network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:35:57 user nova-compute[75285]: WARNING nova.compute.manager [req-d7458e35-d947-44ab-a58f-e9eaa96dd8e0 req-e113bb37-00d6-4b05-9093-a4602aebcc8e service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received unexpected event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 for instance with vm_state active and task_state None.
Nov 10 21:35:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:01 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:36:01 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:36:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-419ec5ef-4637-4ee3-8f24-030d21f103d1" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:36:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-419ec5ef-4637-4ee3-8f24-030d21f103d1" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:36:01 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:36:02 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Updating instance_info_cache with network_info: [{"id": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "address": "fa:16:3e:8d:cc:f7", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36edebc-62", "ovs_interfaceid": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:36:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-419ec5ef-4637-4ee3-8f24-030d21f103d1" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:36:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:36:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:03 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:36:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:04 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:36:04 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:36:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:36:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:36:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:36:04 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:36:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:36:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:36:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:36:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:36:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:36:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:36:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:36:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:36:06 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:36:06 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:36:06 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8744MB free_disk=25.075050354003906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:36:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:36:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:36:06 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 9114d033-d5c9-45df-a865-78b8a977ffcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:36:06 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 419ec5ef-4637-4ee3-8f24-030d21f103d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:36:06 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:36:06 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:36:06 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:36:06 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:36:06 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:36:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:36:08 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:36:08 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:36:08 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:36:08 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:36:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:36:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:36:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "419ec5ef-4637-4ee3-8f24-030d21f103d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:36:28 user nova-compute[75285]: INFO nova.compute.manager [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Terminating instance
Nov 10 21:36:28 user nova-compute[75285]: DEBUG nova.compute.manager [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:28 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Instance destroyed successfully.
Nov 10 21:36:28 user nova-compute[75285]: DEBUG nova.objects.instance [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lazy-loading 'resources' on Instance uuid 419ec5ef-4637-4ee3-8f24-030d21f103d1 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:31:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-60175088',display_name='tempest-AttachVolumeNegativeTest-server-60175088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-60175088',id=41,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnGkbFJODohlwwlJXvj5cF6Me0ixbIbw3g6eCmJDcclujBmFjWy3RaHS40LzjWRUsJ7+ZXxk8oSbtU6mxxs7d4KQ+o/lZfLz5mhcvXEM3Uqf2hRGeyXp2gVv4RqKsdtgQ==',key_name='tempest-keypair-255839765',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:31:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96f56b3b4b3e465f97cf07aa338a57a9',ramdisk_id='',reservation_id='r-pd1gf0ro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-377835946',owner_user_name='tempest-AttachVolumeNegativeTest-377835946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:31:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7762d2ba25d4427ae7ed839e2bbbde4',uuid=419ec5ef-4637-4ee3-8f24-030d21f103d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "address": "fa:16:3e:8d:cc:f7", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36edebc-62", "ovs_interfaceid": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converting VIF {"id": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "address": "fa:16:3e:8d:cc:f7", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36edebc-62", "ovs_interfaceid": "f36edebc-6214-47f3-a7aa-e2e8e016e9ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:cc:f7,bridge_name='br-int',has_traffic_filtering=True,id=f36edebc-6214-47f3-a7aa-e2e8e016e9ff,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36edebc-62') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG os_vif [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:cc:f7,bridge_name='br-int',has_traffic_filtering=True,id=f36edebc-6214-47f3-a7aa-e2e8e016e9ff,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36edebc-62') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf36edebc-62, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8a97ec5-21b7-4948-8918-3af9ab0106e7) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:36:28 user nova-compute[75285]: INFO os_vif [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:cc:f7,bridge_name='br-int',has_traffic_filtering=True,id=f36edebc-6214-47f3-a7aa-e2e8e016e9ff,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36edebc-62')
Nov 10 21:36:28 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Deleting instance files /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1_del
Nov 10 21:36:28 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Deletion of /opt/stack/data/nova/instances/419ec5ef-4637-4ee3-8f24-030d21f103d1_del complete
Nov 10 21:36:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-795ff7bc-fa9d-4050-8c13-0e279aa3e678 req-de02d022-0c17-4ea1-bbfc-666beef0fa94 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Received event network-vif-unplugged-f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-795ff7bc-fa9d-4050-8c13-0e279aa3e678 req-de02d022-0c17-4ea1-bbfc-666beef0fa94 service nova] Acquiring lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-795ff7bc-fa9d-4050-8c13-0e279aa3e678 req-de02d022-0c17-4ea1-bbfc-666beef0fa94 service nova] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-795ff7bc-fa9d-4050-8c13-0e279aa3e678 req-de02d022-0c17-4ea1-bbfc-666beef0fa94 service nova] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-795ff7bc-fa9d-4050-8c13-0e279aa3e678 req-de02d022-0c17-4ea1-bbfc-666beef0fa94 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] No waiting events found dispatching network-vif-unplugged-f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-795ff7bc-fa9d-4050-8c13-0e279aa3e678 req-de02d022-0c17-4ea1-bbfc-666beef0fa94 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Received event network-vif-unplugged-f36edebc-6214-47f3-a7aa-e2e8e016e9ff for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:36:28 user nova-compute[75285]: INFO nova.compute.manager [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 10 21:36:28 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:36:28 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:36:29 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:36:29 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Took 0.99 seconds to deallocate network for instance.
Nov 10 21:36:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:36:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:36:30 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:36:30 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:36:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:36:30 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Deleted allocations for instance 419ec5ef-4637-4ee3-8f24-030d21f103d1
Nov 10 21:36:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-17fd1e14-a834-4f29-a074-bff0a4208d19 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:36:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2276f2b-0ed3-434e-8065-3dc039d2eb41 req-257d78cd-f0eb-440d-a7c6-2cf0c2438b59 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Received event network-vif-plugged-f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:36:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2276f2b-0ed3-434e-8065-3dc039d2eb41 req-257d78cd-f0eb-440d-a7c6-2cf0c2438b59 service nova] Acquiring lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:36:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2276f2b-0ed3-434e-8065-3dc039d2eb41 req-257d78cd-f0eb-440d-a7c6-2cf0c2438b59 service nova] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:36:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e2276f2b-0ed3-434e-8065-3dc039d2eb41 req-257d78cd-f0eb-440d-a7c6-2cf0c2438b59 service nova] Lock "419ec5ef-4637-4ee3-8f24-030d21f103d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:36:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2276f2b-0ed3-434e-8065-3dc039d2eb41 req-257d78cd-f0eb-440d-a7c6-2cf0c2438b59 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] No waiting events found dispatching network-vif-plugged-f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:36:30 user nova-compute[75285]: WARNING nova.compute.manager [req-e2276f2b-0ed3-434e-8065-3dc039d2eb41 req-257d78cd-f0eb-440d-a7c6-2cf0c2438b59 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Received unexpected event network-vif-plugged-f36edebc-6214-47f3-a7aa-e2e8e016e9ff for instance with vm_state deleted and task_state None.
Nov 10 21:36:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-e2276f2b-0ed3-434e-8065-3dc039d2eb41 req-257d78cd-f0eb-440d-a7c6-2cf0c2438b59 service nova] [instance: 419ec5ef-4637-4ee3-8f24-030d21f103d1] Received event network-vif-deleted-f36edebc-6214-47f3-a7aa-e2e8e016e9ff {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:36:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:36:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:36:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:36:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:36:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:36:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:36:39 user nova-compute[75285]: INFO nova.compute.claims [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Claim successful on node user
Nov 10 21:36:39 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:36:39 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:36:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:36:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:36:40 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:36:40 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG nova.policy [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b47da8e21f44b98aec923a5bf71b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362608e7cf3b4c1fb9dc6187091b3dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:36:40 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Creating image(s)
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "/opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "/opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "/opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.206s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.187s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk 1073741824" returned: 0 in 0.058s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:36:40 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Successfully created port: 824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Cannot resize image /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Ensure instance console log exists: /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Successfully updated port: 824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquired lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-d805daa5-9364-4af6-9a22-bba3b2e194e2 req-72b7c06d-dfde-4256-90dc-6e9d9e0ec268 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Received event network-changed-824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-d805daa5-9364-4af6-9a22-bba3b2e194e2 req-72b7c06d-dfde-4256-90dc-6e9d9e0ec268 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Refreshing instance network info cache due to event network-changed-824fc651-afa7-43bf-b81b-4f4a441c664b. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d805daa5-9364-4af6-9a22-bba3b2e194e2 req-72b7c06d-dfde-4256-90dc-6e9d9e0ec268 service nova] Acquiring lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:36:41 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.network.neutron [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updating instance_info_cache with network_info: [{"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Releasing lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Instance network_info: |[{"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d805daa5-9364-4af6-9a22-bba3b2e194e2 req-72b7c06d-dfde-4256-90dc-6e9d9e0ec268 service nova] Acquired lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.network.neutron [req-d805daa5-9364-4af6-9a22-bba3b2e194e2 req-72b7c06d-dfde-4256-90dc-6e9d9e0ec268 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Refreshing network info cache for port 824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Start _get_guest_xml network_info=[{"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:36:42 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:36:42 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1258895728',display_name='tempest-TestStampPattern-server-1258895728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1258895728',id=42,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDesKwnov6nE2ld9TlR2fU3g0q2iM+VKiUlmhK8jP1iPmNHB6lDKQy4ay9Gx6aPViDAsMciHIGIxIzSorT0IkxMhTgbfUY9SEgK+3RievcFZ227mhE1qSONbcnrF6fHmFg==',key_name='tempest-TestStampPattern-930691110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='362608e7cf3b4c1fb9dc6187091b3dbb',ramdisk_id='',reservation_id='r-w4by6ug0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-248662818',owner_user_name='tempest-TestStampPattern-248662818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:36:40Z,user_data=None,user_id='4b47da8e21f44b98aec923a5bf71b361',uuid=b50a2144-75e2-4124-9be7-7c5f9a5ce647,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Converting VIF {"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:50:9b,bridge_name='br-int',has_traffic_filtering=True,id=824fc651-afa7-43bf-b81b-4f4a441c664b,network=Network(f2a1706e-9d15-46ca-93a2-9fb70223a9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap824fc651-af') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.objects.instance [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lazy-loading 'pci_devices' on Instance uuid b50a2144-75e2-4124-9be7-7c5f9a5ce647 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:36:42 user nova-compute[75285]:   <uuid>b50a2144-75e2-4124-9be7-7c5f9a5ce647</uuid>
Nov 10 21:36:42 user nova-compute[75285]:   <name>instance-0000002a</name>
Nov 10 21:36:42 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:36:42 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:36:42 user nova-compute[75285]:   <metadata>
Nov 10 21:36:42 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:36:42 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:36:42 user nova-compute[75285]:       <nova:name>tempest-TestStampPattern-server-1258895728</nova:name>
Nov 10 21:36:42 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:36:42</nova:creationTime>
Nov 10 21:36:42 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:36:42 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:36:42 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:36:42 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:36:42 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:36:42 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:36:42 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:36:42 user nova-compute[75285]:       <nova:owner>
Nov 10 21:36:42 user nova-compute[75285]:         <nova:user uuid="4b47da8e21f44b98aec923a5bf71b361">tempest-TestStampPattern-248662818-project-member</nova:user>
Nov 10 21:36:42 user nova-compute[75285]:         <nova:project uuid="362608e7cf3b4c1fb9dc6187091b3dbb">tempest-TestStampPattern-248662818</nova:project>
Nov 10 21:36:42 user nova-compute[75285]:       </nova:owner>
Nov 10 21:36:42 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:36:42 user nova-compute[75285]:       <nova:ports>
Nov 10 21:36:42 user nova-compute[75285]:         <nova:port uuid="824fc651-afa7-43bf-b81b-4f4a441c664b">
Nov 10 21:36:42 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 21:36:42 user nova-compute[75285]:         </nova:port>
Nov 10 21:36:42 user nova-compute[75285]:       </nova:ports>
Nov 10 21:36:42 user nova-compute[75285]:     </nova:instance>
Nov 10 21:36:42 user nova-compute[75285]:   </metadata>
Nov 10 21:36:42 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:36:42 user nova-compute[75285]:     <system>
Nov 10 21:36:42 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:36:42 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:36:42 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:36:42 user nova-compute[75285]:       <entry name="serial">b50a2144-75e2-4124-9be7-7c5f9a5ce647</entry>
Nov 10 21:36:42 user nova-compute[75285]:       <entry name="uuid">b50a2144-75e2-4124-9be7-7c5f9a5ce647</entry>
Nov 10 21:36:42 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:36:42 user nova-compute[75285]:     </system>
Nov 10 21:36:42 user nova-compute[75285]:   </sysinfo>
Nov 10 21:36:42 user nova-compute[75285]:   <os>
Nov 10 21:36:42 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:36:42 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:36:42 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:36:42 user nova-compute[75285]:   </os>
Nov 10 21:36:42 user nova-compute[75285]:   <features>
Nov 10 21:36:42 user nova-compute[75285]:     <acpi/>
Nov 10 21:36:42 user nova-compute[75285]:     <apic/>
Nov 10 21:36:42 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:36:42 user nova-compute[75285]:   </features>
Nov 10 21:36:42 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:36:42 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:36:42 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:36:42 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:36:42 user nova-compute[75285]:   </clock>
Nov 10 21:36:42 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:36:42 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:36:42 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:36:42 user nova-compute[75285]:   </cpu>
Nov 10 21:36:42 user nova-compute[75285]:   <devices>
Nov 10 21:36:42 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:36:42 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:36:42 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk"/>
Nov 10 21:36:42 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:36:42 user nova-compute[75285]:     </disk>
Nov 10 21:36:42 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:36:42 user nova-compute[75285]:       <mac address="fa:16:3e:7e:50:9b"/>
Nov 10 21:36:42 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:36:42 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:36:42 user nova-compute[75285]:       <target dev="tap824fc651-af"/>
Nov 10 21:36:42 user nova-compute[75285]:     </interface>
Nov 10 21:36:42 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:36:42 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/console.log" append="off"/>
Nov 10 21:36:42 user nova-compute[75285]:     </serial>
Nov 10 21:36:42 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:36:42 user nova-compute[75285]:     <video>
Nov 10 21:36:42 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:36:42 user nova-compute[75285]:     </video>
Nov 10 21:36:42 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:36:42 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:36:42 user nova-compute[75285]:     </rng>
Nov 10 21:36:42 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:36:42 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:36:42 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:36:42 user nova-compute[75285]:     </memballoon>
Nov 10 21:36:42 user nova-compute[75285]:   </devices>
Nov 10 21:36:42 user nova-compute[75285]: </domain>
Nov 10 21:36:42 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1258895728',display_name='tempest-TestStampPattern-server-1258895728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1258895728',id=42,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDesKwnov6nE2ld9TlR2fU3g0q2iM+VKiUlmhK8jP1iPmNHB6lDKQy4ay9Gx6aPViDAsMciHIGIxIzSorT0IkxMhTgbfUY9SEgK+3RievcFZ227mhE1qSONbcnrF6fHmFg==',key_name='tempest-TestStampPattern-930691110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='362608e7cf3b4c1fb9dc6187091b3dbb',ramdisk_id='',reservation_id='r-w4by6ug0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-248662818',owner_user_name='tempest-TestStampPattern-248662818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:36:40Z,user_data=None,user_id='4b47da8e21f44b98aec923a5bf71b361',uuid=b50a2144-75e2-4124-9be7-7c5f9a5ce647,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Converting VIF {"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:50:9b,bridge_name='br-int',has_traffic_filtering=True,id=824fc651-afa7-43bf-b81b-4f4a441c664b,network=Network(f2a1706e-9d15-46ca-93a2-9fb70223a9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap824fc651-af') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG os_vif [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:50:9b,bridge_name='br-int',has_traffic_filtering=True,id=824fc651-afa7-43bf-b81b-4f4a441c664b,network=Network(f2a1706e-9d15-46ca-93a2-9fb70223a9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap824fc651-af') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21993fd5-62d3-5e47-b90a-595c3e5b7773', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap824fc651-af, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap824fc651-af, col_values=(('qos', UUID('a3222c3f-ec31-454f-9380-bab83c5124c2')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap824fc651-af, col_values=(('external_ids', {'iface-id': '824fc651-afa7-43bf-b81b-4f4a441c664b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:50:9b', 'vm-uuid': 'b50a2144-75e2-4124-9be7-7c5f9a5ce647'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:42 user nova-compute[75285]: INFO os_vif [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:50:9b,bridge_name='br-int',has_traffic_filtering=True,id=824fc651-afa7-43bf-b81b-4f4a441c664b,network=Network(f2a1706e-9d15-46ca-93a2-9fb70223a9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap824fc651-af')
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] No VIF found with MAC fa:16:3e:7e:50:9b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.network.neutron [req-d805daa5-9364-4af6-9a22-bba3b2e194e2 req-72b7c06d-dfde-4256-90dc-6e9d9e0ec268 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updated VIF entry in instance network info cache for port 824fc651-afa7-43bf-b81b-4f4a441c664b. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG nova.network.neutron [req-d805daa5-9364-4af6-9a22-bba3b2e194e2 req-72b7c06d-dfde-4256-90dc-6e9d9e0ec268 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updating instance_info_cache with network_info: [{"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:36:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d805daa5-9364-4af6-9a22-bba3b2e194e2 req-72b7c06d-dfde-4256-90dc-6e9d9e0ec268 service nova] Releasing lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:36:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-d035d695-2cf2-4f2b-b650-797b2106add8 req-16214323-5131-4388-91b4-a9e48049346c service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Received event network-vif-plugged-824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:36:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d035d695-2cf2-4f2b-b650-797b2106add8 req-16214323-5131-4388-91b4-a9e48049346c service nova] Acquiring lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:36:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d035d695-2cf2-4f2b-b650-797b2106add8 req-16214323-5131-4388-91b4-a9e48049346c service nova] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:36:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d035d695-2cf2-4f2b-b650-797b2106add8 req-16214323-5131-4388-91b4-a9e48049346c service nova] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:36:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-d035d695-2cf2-4f2b-b650-797b2106add8 req-16214323-5131-4388-91b4-a9e48049346c service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] No waiting events found dispatching network-vif-plugged-824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:36:43 user nova-compute[75285]: WARNING nova.compute.manager [req-d035d695-2cf2-4f2b-b650-797b2106add8 req-16214323-5131-4388-91b4-a9e48049346c service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Received unexpected event network-vif-plugged-824fc651-afa7-43bf-b81b-4f4a441c664b for instance with vm_state building and task_state spawning.
Nov 10 21:36:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:45 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:36:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:36:45 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Instance spawned successfully.
Nov 10 21:36:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:36:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:36:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:36:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:36:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:36:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:36:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:36:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-2d5e64a1-dde2-4b3d-9e6b-5fcfbf34f5ca req-67f0f207-63cb-420e-9b55-64a19cf27253 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Received event network-vif-plugged-824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:36:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2d5e64a1-dde2-4b3d-9e6b-5fcfbf34f5ca req-67f0f207-63cb-420e-9b55-64a19cf27253 service nova] Acquiring lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:36:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2d5e64a1-dde2-4b3d-9e6b-5fcfbf34f5ca req-67f0f207-63cb-420e-9b55-64a19cf27253 service nova] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:36:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2d5e64a1-dde2-4b3d-9e6b-5fcfbf34f5ca req-67f0f207-63cb-420e-9b55-64a19cf27253 service nova] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:36:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-2d5e64a1-dde2-4b3d-9e6b-5fcfbf34f5ca req-67f0f207-63cb-420e-9b55-64a19cf27253 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] No waiting events found dispatching network-vif-plugged-824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:36:45 user nova-compute[75285]: WARNING nova.compute.manager [req-2d5e64a1-dde2-4b3d-9e6b-5fcfbf34f5ca req-67f0f207-63cb-420e-9b55-64a19cf27253 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Received unexpected event network-vif-plugged-824fc651-afa7-43bf-b81b-4f4a441c664b for instance with vm_state building and task_state spawning.
Nov 10 21:36:46 user nova-compute[75285]: INFO nova.compute.manager [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 10 21:36:46 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:36:46 user nova-compute[75285]: INFO nova.compute.manager [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Took 6.53 seconds to build instance.
Nov 10 21:36:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5dbadb4a-63c5-4126-9113-a37b801946d9 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.631s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:36:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:36:54 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:36:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:37:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:02 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:37:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:37:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:37:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:37:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:37:02 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:37:02 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:37:03 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updating instance_info_cache with network_info: [{"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:37:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-9114d033-d5c9-45df-a865-78b8a977ffcc" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:37:03 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:37:04 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:37:05 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:37:05 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:37:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:37:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:37:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:37:05 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:37:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:37:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:37:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:37:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:37:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:37:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:37:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:37:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:37:06 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:37:06 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:37:06 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=25.06446075439453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:37:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:37:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:37:07 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 9114d033-d5c9-45df-a865-78b8a977ffcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:37:07 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:37:07 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:37:07 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:37:07 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:37:07 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:37:07 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:37:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:37:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:37:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:37:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:37:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:37:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:37:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:15 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:37:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:37:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:37:21 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:37:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:37:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:37:21 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:37:21 user nova-compute[75285]: INFO nova.compute.claims [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Claim successful on node user
Nov 10 21:37:22 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:37:22 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:37:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG nova.policy [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7762d2ba25d4427ae7ed839e2bbbde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f56b3b4b3e465f97cf07aa338a57a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:37:22 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Creating image(s)
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "/opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "/opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.169s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.169s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk 1073741824" returned: 0 in 0.052s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Successfully created port: dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.165s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:37:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Cannot resize image /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Ensure instance console log exists: /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Successfully updated port: dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "refresh_cache-fbec82a1-7e08-4ccb-a2a8-ff250d507110" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquired lock "refresh_cache-fbec82a1-7e08-4ccb-a2a8-ff250d507110" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-63b36933-4946-4e38-b5f4-c2a3b9a5b447 req-cab24bc6-e131-4367-a686-74c708ae460d service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Received event network-changed-dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.compute.manager [req-63b36933-4946-4e38-b5f4-c2a3b9a5b447 req-cab24bc6-e131-4367-a686-74c708ae460d service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Refreshing instance network info cache due to event network-changed-dc9a3797-4ebe-4970-bae9-fb4fa212c605. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-63b36933-4946-4e38-b5f4-c2a3b9a5b447 req-cab24bc6-e131-4367-a686-74c708ae460d service nova] Acquiring lock "refresh_cache-fbec82a1-7e08-4ccb-a2a8-ff250d507110" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.network.neutron [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Updating instance_info_cache with network_info: [{"id": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "address": "fa:16:3e:6b:92:7c", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc9a3797-4e", "ovs_interfaceid": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Releasing lock "refresh_cache-fbec82a1-7e08-4ccb-a2a8-ff250d507110" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Instance network_info: |[{"id": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "address": "fa:16:3e:6b:92:7c", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc9a3797-4e", "ovs_interfaceid": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-63b36933-4946-4e38-b5f4-c2a3b9a5b447 req-cab24bc6-e131-4367-a686-74c708ae460d service nova] Acquired lock "refresh_cache-fbec82a1-7e08-4ccb-a2a8-ff250d507110" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.network.neutron [req-63b36933-4946-4e38-b5f4-c2a3b9a5b447 req-cab24bc6-e131-4367-a686-74c708ae460d service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Refreshing network info cache for port dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Start _get_guest_xml network_info=[{"id": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "address": "fa:16:3e:6b:92:7c", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc9a3797-4e", "ovs_interfaceid": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:37:23 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:37:23 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2137162264',display_name='tempest-AttachVolumeNegativeTest-server-2137162264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2137162264',id=43,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS6r4o8dBNuS1eDrLvzWiknL42mShQrOTbDCzHlkuNnGJoxlNE5jYZA+xe4cJwQ7IHonYHOz33A+sZARyBXtvPHnM0OilPNRL8AfqgVqNNC6cPUL5rWm5dFdCrDjBLI+A==',key_name='tempest-keypair-2053353845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96f56b3b4b3e465f97cf07aa338a57a9',ramdisk_id='',reservation_id='r-77qj0dt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-377835946',owner_user_name='tempest-AttachVolumeNegativeTest-377835946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:37:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7762d2ba25d4427ae7ed839e2bbbde4',uuid=fbec82a1-7e08-4ccb-a2a8-ff250d507110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "address": "fa:16:3e:6b:92:7c", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc9a3797-4e", "ovs_interfaceid": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converting VIF {"id": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "address": "fa:16:3e:6b:92:7c", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc9a3797-4e", "ovs_interfaceid": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:92:7c,bridge_name='br-int',has_traffic_filtering=True,id=dc9a3797-4ebe-4970-bae9-fb4fa212c605,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc9a3797-4e') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.objects.instance [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lazy-loading 'pci_devices' on Instance uuid fbec82a1-7e08-4ccb-a2a8-ff250d507110 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:37:23 user nova-compute[75285]:   <uuid>fbec82a1-7e08-4ccb-a2a8-ff250d507110</uuid>
Nov 10 21:37:23 user nova-compute[75285]:   <name>instance-0000002b</name>
Nov 10 21:37:23 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:37:23 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:37:23 user nova-compute[75285]:   <metadata>
Nov 10 21:37:23 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:37:23 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:37:23 user nova-compute[75285]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2137162264</nova:name>
Nov 10 21:37:23 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:37:23</nova:creationTime>
Nov 10 21:37:23 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:37:23 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:37:23 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:37:23 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:37:23 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:37:23 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:37:23 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:37:23 user nova-compute[75285]:       <nova:owner>
Nov 10 21:37:23 user nova-compute[75285]:         <nova:user uuid="d7762d2ba25d4427ae7ed839e2bbbde4">tempest-AttachVolumeNegativeTest-377835946-project-member</nova:user>
Nov 10 21:37:23 user nova-compute[75285]:         <nova:project uuid="96f56b3b4b3e465f97cf07aa338a57a9">tempest-AttachVolumeNegativeTest-377835946</nova:project>
Nov 10 21:37:23 user nova-compute[75285]:       </nova:owner>
Nov 10 21:37:23 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:37:23 user nova-compute[75285]:       <nova:ports>
Nov 10 21:37:23 user nova-compute[75285]:         <nova:port uuid="dc9a3797-4ebe-4970-bae9-fb4fa212c605">
Nov 10 21:37:23 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 21:37:23 user nova-compute[75285]:         </nova:port>
Nov 10 21:37:23 user nova-compute[75285]:       </nova:ports>
Nov 10 21:37:23 user nova-compute[75285]:     </nova:instance>
Nov 10 21:37:23 user nova-compute[75285]:   </metadata>
Nov 10 21:37:23 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:37:23 user nova-compute[75285]:     <system>
Nov 10 21:37:23 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:37:23 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:37:23 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:37:23 user nova-compute[75285]:       <entry name="serial">fbec82a1-7e08-4ccb-a2a8-ff250d507110</entry>
Nov 10 21:37:23 user nova-compute[75285]:       <entry name="uuid">fbec82a1-7e08-4ccb-a2a8-ff250d507110</entry>
Nov 10 21:37:23 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:37:23 user nova-compute[75285]:     </system>
Nov 10 21:37:23 user nova-compute[75285]:   </sysinfo>
Nov 10 21:37:23 user nova-compute[75285]:   <os>
Nov 10 21:37:23 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:37:23 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:37:23 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:37:23 user nova-compute[75285]:   </os>
Nov 10 21:37:23 user nova-compute[75285]:   <features>
Nov 10 21:37:23 user nova-compute[75285]:     <acpi/>
Nov 10 21:37:23 user nova-compute[75285]:     <apic/>
Nov 10 21:37:23 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:37:23 user nova-compute[75285]:   </features>
Nov 10 21:37:23 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:37:23 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:37:23 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:37:23 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:37:23 user nova-compute[75285]:   </clock>
Nov 10 21:37:23 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:37:23 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:37:23 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:37:23 user nova-compute[75285]:   </cpu>
Nov 10 21:37:23 user nova-compute[75285]:   <devices>
Nov 10 21:37:23 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:37:23 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:37:23 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk"/>
Nov 10 21:37:23 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:37:23 user nova-compute[75285]:     </disk>
Nov 10 21:37:23 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:37:23 user nova-compute[75285]:       <mac address="fa:16:3e:6b:92:7c"/>
Nov 10 21:37:23 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:37:23 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:37:23 user nova-compute[75285]:       <target dev="tapdc9a3797-4e"/>
Nov 10 21:37:23 user nova-compute[75285]:     </interface>
Nov 10 21:37:23 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:37:23 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/console.log" append="off"/>
Nov 10 21:37:23 user nova-compute[75285]:     </serial>
Nov 10 21:37:23 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:37:23 user nova-compute[75285]:     <video>
Nov 10 21:37:23 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:37:23 user nova-compute[75285]:     </video>
Nov 10 21:37:23 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:37:23 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:37:23 user nova-compute[75285]:     </rng>
Nov 10 21:37:23 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:37:23 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:37:23 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:37:23 user nova-compute[75285]:     </memballoon>
Nov 10 21:37:23 user nova-compute[75285]:   </devices>
Nov 10 21:37:23 user nova-compute[75285]: </domain>
Nov 10 21:37:23 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2137162264',display_name='tempest-AttachVolumeNegativeTest-server-2137162264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2137162264',id=43,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS6r4o8dBNuS1eDrLvzWiknL42mShQrOTbDCzHlkuNnGJoxlNE5jYZA+xe4cJwQ7IHonYHOz33A+sZARyBXtvPHnM0OilPNRL8AfqgVqNNC6cPUL5rWm5dFdCrDjBLI+A==',key_name='tempest-keypair-2053353845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96f56b3b4b3e465f97cf07aa338a57a9',ramdisk_id='',reservation_id='r-77qj0dt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-377835946',owner_user_name='tempest-AttachVolumeNegativeTest-377835946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:37:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7762d2ba25d4427ae7ed839e2bbbde4',uuid=fbec82a1-7e08-4ccb-a2a8-ff250d507110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "address": "fa:16:3e:6b:92:7c", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc9a3797-4e", "ovs_interfaceid": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converting VIF {"id": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "address": "fa:16:3e:6b:92:7c", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc9a3797-4e", "ovs_interfaceid": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:92:7c,bridge_name='br-int',has_traffic_filtering=True,id=dc9a3797-4ebe-4970-bae9-fb4fa212c605,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc9a3797-4e') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG os_vif [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:92:7c,bridge_name='br-int',has_traffic_filtering=True,id=dc9a3797-4ebe-4970-bae9-fb4fa212c605,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc9a3797-4e') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ace9dcaa-4c87-5549-b95d-fff60348e628', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc9a3797-4e, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc9a3797-4e, col_values=(('qos', UUID('af606972-7952-4668-a628-95ea29fad6cb')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc9a3797-4e, col_values=(('external_ids', {'iface-id': 'dc9a3797-4ebe-4970-bae9-fb4fa212c605', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:92:7c', 'vm-uuid': 'fbec82a1-7e08-4ccb-a2a8-ff250d507110'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:37:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:24 user nova-compute[75285]: INFO os_vif [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:92:7c,bridge_name='br-int',has_traffic_filtering=True,id=dc9a3797-4ebe-4970-bae9-fb4fa212c605,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc9a3797-4e')
Nov 10 21:37:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:37:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] No VIF found with MAC fa:16:3e:6b:92:7c, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:37:24 user nova-compute[75285]: DEBUG nova.network.neutron [req-63b36933-4946-4e38-b5f4-c2a3b9a5b447 req-cab24bc6-e131-4367-a686-74c708ae460d service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Updated VIF entry in instance network info cache for port dc9a3797-4ebe-4970-bae9-fb4fa212c605. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:37:24 user nova-compute[75285]: DEBUG nova.network.neutron [req-63b36933-4946-4e38-b5f4-c2a3b9a5b447 req-cab24bc6-e131-4367-a686-74c708ae460d service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Updating instance_info_cache with network_info: [{"id": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "address": "fa:16:3e:6b:92:7c", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc9a3797-4e", "ovs_interfaceid": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:37:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-63b36933-4946-4e38-b5f4-c2a3b9a5b447 req-cab24bc6-e131-4367-a686-74c708ae460d service nova] Releasing lock "refresh_cache-fbec82a1-7e08-4ccb-a2a8-ff250d507110" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:37:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-922bb441-055d-4221-ae83-5ffe3c041296 req-23b4c04a-dd91-4774-8496-47cf96fc4b48 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Received event network-vif-plugged-dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:37:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-922bb441-055d-4221-ae83-5ffe3c041296 req-23b4c04a-dd91-4774-8496-47cf96fc4b48 service nova] Acquiring lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:37:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-922bb441-055d-4221-ae83-5ffe3c041296 req-23b4c04a-dd91-4774-8496-47cf96fc4b48 service nova] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:37:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-922bb441-055d-4221-ae83-5ffe3c041296 req-23b4c04a-dd91-4774-8496-47cf96fc4b48 service nova] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:37:25 user nova-compute[75285]: DEBUG nova.compute.manager [req-922bb441-055d-4221-ae83-5ffe3c041296 req-23b4c04a-dd91-4774-8496-47cf96fc4b48 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] No waiting events found dispatching network-vif-plugged-dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:37:25 user nova-compute[75285]: WARNING nova.compute.manager [req-922bb441-055d-4221-ae83-5ffe3c041296 req-23b4c04a-dd91-4774-8496-47cf96fc4b48 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Received unexpected event network-vif-plugged-dc9a3797-4ebe-4970-bae9-fb4fa212c605 for instance with vm_state building and task_state spawning.
Nov 10 21:37:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:27 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:37:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:37:27 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Instance spawned successfully.
Nov 10 21:37:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:37:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:37:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:37:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:37:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:37:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:37:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:37:27 user nova-compute[75285]: INFO nova.compute.manager [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 10 21:37:27 user nova-compute[75285]: DEBUG nova.compute.manager [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:37:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-c8be04e7-cdca-4e79-8efc-3271eae88e6d req-759e080c-cd8e-4ad3-95b4-4721bda9961a service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Received event network-vif-plugged-dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:37:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c8be04e7-cdca-4e79-8efc-3271eae88e6d req-759e080c-cd8e-4ad3-95b4-4721bda9961a service nova] Acquiring lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:37:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c8be04e7-cdca-4e79-8efc-3271eae88e6d req-759e080c-cd8e-4ad3-95b4-4721bda9961a service nova] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:37:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c8be04e7-cdca-4e79-8efc-3271eae88e6d req-759e080c-cd8e-4ad3-95b4-4721bda9961a service nova] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:37:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-c8be04e7-cdca-4e79-8efc-3271eae88e6d req-759e080c-cd8e-4ad3-95b4-4721bda9961a service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] No waiting events found dispatching network-vif-plugged-dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:37:27 user nova-compute[75285]: WARNING nova.compute.manager [req-c8be04e7-cdca-4e79-8efc-3271eae88e6d req-759e080c-cd8e-4ad3-95b4-4721bda9961a service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Received unexpected event network-vif-plugged-dc9a3797-4ebe-4970-bae9-fb4fa212c605 for instance with vm_state building and task_state spawning.
Nov 10 21:37:27 user nova-compute[75285]: INFO nova.compute.manager [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Took 5.75 seconds to build instance.
Nov 10 21:37:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f3270915-8ca9-4291-b443-31558c90140a tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.863s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:37:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:37:43 user nova-compute[75285]: INFO nova.compute.manager [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Terminating instance
Nov 10 21:37:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-7914df3d-7b8e-48e9-a53b-20e3f19b8a9f req-518c77b1-35a7-4c88-b2af-cba1206b0f91 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-vif-unplugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7914df3d-7b8e-48e9-a53b-20e3f19b8a9f req-518c77b1-35a7-4c88-b2af-cba1206b0f91 service nova] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7914df3d-7b8e-48e9-a53b-20e3f19b8a9f req-518c77b1-35a7-4c88-b2af-cba1206b0f91 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7914df3d-7b8e-48e9-a53b-20e3f19b8a9f req-518c77b1-35a7-4c88-b2af-cba1206b0f91 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-7914df3d-7b8e-48e9-a53b-20e3f19b8a9f req-518c77b1-35a7-4c88-b2af-cba1206b0f91 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] No waiting events found dispatching network-vif-unplugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-7914df3d-7b8e-48e9-a53b-20e3f19b8a9f req-518c77b1-35a7-4c88-b2af-cba1206b0f91 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-vif-unplugged-a766133d-524b-49ef-95a1-205b134ceeb9 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:37:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Instance destroyed successfully.
Nov 10 21:37:44 user nova-compute[75285]: DEBUG nova.objects.instance [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'resources' on Instance uuid 9114d033-d5c9-45df-a865-78b8a977ffcc {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-525137794',display_name='tempest-AttachVolumeTestJSON-server-525137794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-525137794',id=39,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7CslewLFZpEDkSxi0xOqhMnjfSpBoRGh74QRXv2AvpftFuAfVqDK/0oi/qwx56FgDHg0hXRrn34oXrTuQ0qPKz0m7sH3Nx5In+umv3nh8BqCcmGk4OlTWLjeeWuZhD9Q==',key_name='tempest-keypair-774230573',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63bf2d92f6524ec0af61667a9f06bc49',ramdisk_id='',reservation_id='r-vbyj8al6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738528264',owner_user_name='tempest-AttachVolumeTestJSON-738528264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:35:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780e11dc70f54bf88772860118930629',uuid=9114d033-d5c9-45df-a865-78b8a977ffcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converting VIF {"id": "a766133d-524b-49ef-95a1-205b134ceeb9", "address": "fa:16:3e:1c:34:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa766133d-52", "ovs_interfaceid": "a766133d-524b-49ef-95a1-205b134ceeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG os_vif [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa766133d-52, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ffb07cf-68ce-44b9-9c05-30d6774f8eb6) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:37:44 user nova-compute[75285]: INFO os_vif [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:34:4b,bridge_name='br-int',has_traffic_filtering=True,id=a766133d-524b-49ef-95a1-205b134ceeb9,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa766133d-52')
Nov 10 21:37:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Deleting instance files /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc_del
Nov 10 21:37:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Deletion of /opt/stack/data/nova/instances/9114d033-d5c9-45df-a865-78b8a977ffcc_del complete
Nov 10 21:37:44 user nova-compute[75285]: INFO nova.compute.manager [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 10 21:37:44 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:37:44 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:37:45 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:37:45 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Took 0.78 seconds to deallocate network for instance.
Nov 10 21:37:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-ba1e097c-aeac-4bbf-bcff-98c4f862bd46 req-76227a4d-a613-4e4f-80b3-70f2adc03106 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-vif-deleted-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:37:45 user nova-compute[75285]: INFO nova.compute.manager [req-ba1e097c-aeac-4bbf-bcff-98c4f862bd46 req-76227a4d-a613-4e4f-80b3-70f2adc03106 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Neutron deleted interface a766133d-524b-49ef-95a1-205b134ceeb9; detaching it from the instance and deleting it from the info cache
Nov 10 21:37:45 user nova-compute[75285]: DEBUG nova.network.neutron [req-ba1e097c-aeac-4bbf-bcff-98c4f862bd46 req-76227a4d-a613-4e4f-80b3-70f2adc03106 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:37:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-ba1e097c-aeac-4bbf-bcff-98c4f862bd46 req-76227a4d-a613-4e4f-80b3-70f2adc03106 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Detach interface failed, port_id=a766133d-524b-49ef-95a1-205b134ceeb9, reason: Instance 9114d033-d5c9-45df-a865-78b8a977ffcc could not be found. {{(pid=75285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 21:37:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:37:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:37:45 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:37:45 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:37:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:37:45 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Deleted allocations for instance 9114d033-d5c9-45df-a865-78b8a977ffcc
Nov 10 21:37:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-80333a04-f6d1-417c-9be8-c56a60757c83 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.009s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:37:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-2b7258b8-3207-423c-b6d9-ae5b97fcfa6d req-7da8056c-f615-4db4-ac14-128c949059f3 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:37:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2b7258b8-3207-423c-b6d9-ae5b97fcfa6d req-7da8056c-f615-4db4-ac14-128c949059f3 service nova] Acquiring lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:37:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2b7258b8-3207-423c-b6d9-ae5b97fcfa6d req-7da8056c-f615-4db4-ac14-128c949059f3 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:37:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2b7258b8-3207-423c-b6d9-ae5b97fcfa6d req-7da8056c-f615-4db4-ac14-128c949059f3 service nova] Lock "9114d033-d5c9-45df-a865-78b8a977ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:37:45 user nova-compute[75285]: DEBUG nova.compute.manager [req-2b7258b8-3207-423c-b6d9-ae5b97fcfa6d req-7da8056c-f615-4db4-ac14-128c949059f3 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] No waiting events found dispatching network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:37:45 user nova-compute[75285]: WARNING nova.compute.manager [req-2b7258b8-3207-423c-b6d9-ae5b97fcfa6d req-7da8056c-f615-4db4-ac14-128c949059f3 service nova] [instance: 9114d033-d5c9-45df-a865-78b8a977ffcc] Received unexpected event network-vif-plugged-a766133d-524b-49ef-95a1-205b134ceeb9 for instance with vm_state deleted and task_state None.
Nov 10 21:37:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:55 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:37:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:37:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:38:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:38:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:38:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:38:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:38:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:04 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:38:04 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:38:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:38:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:38:04 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:38:05 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updating instance_info_cache with network_info: [{"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:38:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:38:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:38:05 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:38:05 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:38:07 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:38:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:38:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:38:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:38:07 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:38:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:38:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:38:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:38:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:38:08 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:38:08 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:38:08 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=25.059417724609375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:38:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:38:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:38:08 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:38:08 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance fbec82a1-7e08-4ccb-a2a8-ff250d507110 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:38:08 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:38:08 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:38:08 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:38:08 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:38:09 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:38:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:38:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:38:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:38:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:38:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:38:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:38:11 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:38:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:38:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:38:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Verify base images {{(pid=75285) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Image id e00023c7-f7f3-49f2-b464-c809b7ab7608 yields fingerprint 9f11daa83b3f1abc3336c0af587b96a9e07402a1 {{(pid=75285) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 21:38:29 user nova-compute[75285]: INFO nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] image e00023c7-f7f3-49f2-b464-c809b7ab7608 at (/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1): checking
Nov 10 21:38:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] image e00023c7-f7f3-49f2-b464-c809b7ab7608 at (/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1): image is in use {{(pid=75285) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75285) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] fbec82a1-7e08-4ccb-a2a8-ff250d507110 is a valid instance name {{(pid=75285) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] fbec82a1-7e08-4ccb-a2a8-ff250d507110 has a disk file {{(pid=75285) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance fbec82a1-7e08-4ccb-a2a8-ff250d507110 is backed by 9f11daa83b3f1abc3336c0af587b96a9e07402a1 {{(pid=75285) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] b50a2144-75e2-4124-9be7-7c5f9a5ce647 is a valid instance name {{(pid=75285) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] b50a2144-75e2-4124-9be7-7c5f9a5ce647 has a disk file {{(pid=75285) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 21:38:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:38:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 is backed by 9f11daa83b3f1abc3336c0af587b96a9e07402a1 {{(pid=75285) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 21:38:30 user nova-compute[75285]: WARNING nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Unknown base file: /opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f
Nov 10 21:38:30 user nova-compute[75285]: WARNING nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Unknown base file: /opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2
Nov 10 21:38:30 user nova-compute[75285]: WARNING nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Unknown base file: /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef
Nov 10 21:38:30 user nova-compute[75285]: WARNING nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Unknown base file: /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d
Nov 10 21:38:30 user nova-compute[75285]: WARNING nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Unknown base file: /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2
Nov 10 21:38:30 user nova-compute[75285]: WARNING nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Unknown base file: /opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801
Nov 10 21:38:30 user nova-compute[75285]: INFO nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Active base files: /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1
Nov 10 21:38:30 user nova-compute[75285]: INFO nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Removable base files: /opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f /opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2 /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2 /opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801
Nov 10 21:38:30 user nova-compute[75285]: INFO nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b28a38d386d2b0e7182a9653cc69f7d18fe6483f
Nov 10 21:38:30 user nova-compute[75285]: INFO nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/653e67bf97ecb810b653ebddb45ed8f2550af0a2
Nov 10 21:38:30 user nova-compute[75285]: INFO nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8b4c8b4404256667af7cf2a15a410fc347b757ef
Nov 10 21:38:30 user nova-compute[75285]: INFO nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/585810571889046ffe61869eac0947a53b12a70d
Nov 10 21:38:30 user nova-compute[75285]: INFO nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ca3c4cb0b566011366ad34e7bc6e0dc4acfcdbc2
Nov 10 21:38:30 user nova-compute[75285]: INFO nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/43e3e92a5574a5143cd026027f3ac8451c97c801
Nov 10 21:38:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Verification complete {{(pid=75285) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 10 21:38:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Verify swap images {{(pid=75285) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 10 21:38:30 user nova-compute[75285]: DEBUG nova.virt.libvirt.imagecache [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Verify ephemeral images {{(pid=75285) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 10 21:38:31 user nova-compute[75285]: DEBUG nova.compute.manager [req-d476ae0a-1158-40f9-992a-02ae1f7014ee req-d9ab0d7c-75db-43ec-b825-16d67dba0c99 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Received event network-changed-824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:38:31 user nova-compute[75285]: DEBUG nova.compute.manager [req-d476ae0a-1158-40f9-992a-02ae1f7014ee req-d9ab0d7c-75db-43ec-b825-16d67dba0c99 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Refreshing instance network info cache due to event network-changed-824fc651-afa7-43bf-b81b-4f4a441c664b. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:38:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d476ae0a-1158-40f9-992a-02ae1f7014ee req-d9ab0d7c-75db-43ec-b825-16d67dba0c99 service nova] Acquiring lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:38:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d476ae0a-1158-40f9-992a-02ae1f7014ee req-d9ab0d7c-75db-43ec-b825-16d67dba0c99 service nova] Acquired lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:38:31 user nova-compute[75285]: DEBUG nova.network.neutron [req-d476ae0a-1158-40f9-992a-02ae1f7014ee req-d9ab0d7c-75db-43ec-b825-16d67dba0c99 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Refreshing network info cache for port 824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lazy-loading 'flavor' on Instance uuid b50a2144-75e2-4124-9be7-7c5f9a5ce647 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:38:32 user nova-compute[75285]: INFO nova.compute.manager [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Attaching volume 9d22dbd1-af56-439f-b832-0577a5e2ae04 to /dev/vdb
Nov 10 21:38:32 user nova-compute[75285]: DEBUG os_brick.utils [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7072409a-f92b-443a-a391-2aebc8d4df77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ac1f88-4ecd-4599-bced-4c78267babd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e89545e-a365-45a3-80c7-788c39cd34b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[760e6c52-22fd-44c6-90a0-cc4bd89921bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:38:32 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[169ce1cf-3d6f-496b-b231-446f2ce77be0]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG os_brick.utils [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updating existing volume attachment record: 18feebaa-c34e-4c00-95a8-da9d677f2772 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG nova.network.neutron [req-d476ae0a-1158-40f9-992a-02ae1f7014ee req-d9ab0d7c-75db-43ec-b825-16d67dba0c99 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updated VIF entry in instance network info cache for port 824fc651-afa7-43bf-b81b-4f4a441c664b. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG nova.network.neutron [req-d476ae0a-1158-40f9-992a-02ae1f7014ee req-d9ab0d7c-75db-43ec-b825-16d67dba0c99 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updating instance_info_cache with network_info: [{"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:38:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d476ae0a-1158-40f9-992a-02ae1f7014ee req-d9ab0d7c-75db-43ec-b825-16d67dba0c99 service nova] Releasing lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:38:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:38:37 user nova-compute[75285]: INFO nova.compute.claims [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Claim successful on node user
Nov 10 21:38:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG nova.network.neutron [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:38:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:38:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG nova.policy [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '780e11dc70f54bf88772860118930629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63bf2d92f6524ec0af61667a9f06bc49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:38:37 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Creating image(s)
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "/opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "/opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:38:37 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk 1073741824" returned: 0 in 0.053s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:38:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:38:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:38:38 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:38:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:38:38 user nova-compute[75285]: DEBUG nova.network.neutron [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Successfully created port: 61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:38:38 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:38:38 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Cannot resize image /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:38:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:38:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Ensure instance console log exists: /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:38:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:38:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:38:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.network.neutron [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Successfully updated port: 61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "refresh_cache-b1728988-eadf-468e-9554-ab05b2ddcd4c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquired lock "refresh_cache-b1728988-eadf-468e-9554-ab05b2ddcd4c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.network.neutron [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-eb41676f-1faa-48a5-86eb-24faace993c6 req-5fc4d61f-2ffe-484f-a159-2a72ac77e227 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Received event network-changed-61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-eb41676f-1faa-48a5-86eb-24faace993c6 req-5fc4d61f-2ffe-484f-a159-2a72ac77e227 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Refreshing instance network info cache due to event network-changed-61769235-563d-492b-9e22-01df85111b5f. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-eb41676f-1faa-48a5-86eb-24faace993c6 req-5fc4d61f-2ffe-484f-a159-2a72ac77e227 service nova] Acquiring lock "refresh_cache-b1728988-eadf-468e-9554-ab05b2ddcd4c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.network.neutron [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.network.neutron [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Updating instance_info_cache with network_info: [{"id": "61769235-563d-492b-9e22-01df85111b5f", "address": "fa:16:3e:e6:36:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61769235-56", "ovs_interfaceid": "61769235-563d-492b-9e22-01df85111b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Releasing lock "refresh_cache-b1728988-eadf-468e-9554-ab05b2ddcd4c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Instance network_info: |[{"id": "61769235-563d-492b-9e22-01df85111b5f", "address": "fa:16:3e:e6:36:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61769235-56", "ovs_interfaceid": "61769235-563d-492b-9e22-01df85111b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-eb41676f-1faa-48a5-86eb-24faace993c6 req-5fc4d61f-2ffe-484f-a159-2a72ac77e227 service nova] Acquired lock "refresh_cache-b1728988-eadf-468e-9554-ab05b2ddcd4c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.network.neutron [req-eb41676f-1faa-48a5-86eb-24faace993c6 req-5fc4d61f-2ffe-484f-a159-2a72ac77e227 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Refreshing network info cache for port 61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Start _get_guest_xml network_info=[{"id": "61769235-563d-492b-9e22-01df85111b5f", "address": "fa:16:3e:e6:36:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61769235-56", "ovs_interfaceid": "61769235-563d-492b-9e22-01df85111b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:38:39 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:38:39 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:38:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-319214058',display_name='tempest-AttachVolumeTestJSON-server-319214058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-319214058',id=44,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ2RIxYCQMmIFfEOoE3epQ9wCXGiCXTB+DEbr0u2kJM6suaYv1+fW6uSJokY+ytRQjKd5GJNarDt5WUBYrsHpI0/A+u95pTYDTpR9WjUsEyZw+GOU6Vag3q5UAUJMEI1w==',key_name='tempest-keypair-209731017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63bf2d92f6524ec0af61667a9f06bc49',ramdisk_id='',reservation_id='r-07iwqlqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-738528264',owner_user_name='tempest-AttachVolumeTestJSON-738528264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780e11dc70f54bf88772860118930629',uuid=b1728988-eadf-468e-9554-ab05b2ddcd4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61769235-563d-492b-9e22-01df85111b5f", "address": "fa:16:3e:e6:36:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61769235-56", "ovs_interfaceid": "61769235-563d-492b-9e22-01df85111b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converting VIF {"id": "61769235-563d-492b-9e22-01df85111b5f", "address": "fa:16:3e:e6:36:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61769235-56", "ovs_interfaceid": "61769235-563d-492b-9e22-01df85111b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=61769235-563d-492b-9e22-01df85111b5f,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61769235-56') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.objects.instance [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'pci_devices' on Instance uuid b1728988-eadf-468e-9554-ab05b2ddcd4c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:38:39 user nova-compute[75285]:   <uuid>b1728988-eadf-468e-9554-ab05b2ddcd4c</uuid>
Nov 10 21:38:39 user nova-compute[75285]:   <name>instance-0000002c</name>
Nov 10 21:38:39 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:38:39 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:38:39 user nova-compute[75285]:   <metadata>
Nov 10 21:38:39 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:38:39 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:38:39 user nova-compute[75285]:       <nova:name>tempest-AttachVolumeTestJSON-server-319214058</nova:name>
Nov 10 21:38:39 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:38:39</nova:creationTime>
Nov 10 21:38:39 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:38:39 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:38:39 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:38:39 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:38:39 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:38:39 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:38:39 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:38:39 user nova-compute[75285]:       <nova:owner>
Nov 10 21:38:39 user nova-compute[75285]:         <nova:user uuid="780e11dc70f54bf88772860118930629">tempest-AttachVolumeTestJSON-738528264-project-member</nova:user>
Nov 10 21:38:39 user nova-compute[75285]:         <nova:project uuid="63bf2d92f6524ec0af61667a9f06bc49">tempest-AttachVolumeTestJSON-738528264</nova:project>
Nov 10 21:38:39 user nova-compute[75285]:       </nova:owner>
Nov 10 21:38:39 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:38:39 user nova-compute[75285]:       <nova:ports>
Nov 10 21:38:39 user nova-compute[75285]:         <nova:port uuid="61769235-563d-492b-9e22-01df85111b5f">
Nov 10 21:38:39 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 21:38:39 user nova-compute[75285]:         </nova:port>
Nov 10 21:38:39 user nova-compute[75285]:       </nova:ports>
Nov 10 21:38:39 user nova-compute[75285]:     </nova:instance>
Nov 10 21:38:39 user nova-compute[75285]:   </metadata>
Nov 10 21:38:39 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:38:39 user nova-compute[75285]:     <system>
Nov 10 21:38:39 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:38:39 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:38:39 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:38:39 user nova-compute[75285]:       <entry name="serial">b1728988-eadf-468e-9554-ab05b2ddcd4c</entry>
Nov 10 21:38:39 user nova-compute[75285]:       <entry name="uuid">b1728988-eadf-468e-9554-ab05b2ddcd4c</entry>
Nov 10 21:38:39 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:38:39 user nova-compute[75285]:     </system>
Nov 10 21:38:39 user nova-compute[75285]:   </sysinfo>
Nov 10 21:38:39 user nova-compute[75285]:   <os>
Nov 10 21:38:39 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:38:39 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:38:39 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:38:39 user nova-compute[75285]:   </os>
Nov 10 21:38:39 user nova-compute[75285]:   <features>
Nov 10 21:38:39 user nova-compute[75285]:     <acpi/>
Nov 10 21:38:39 user nova-compute[75285]:     <apic/>
Nov 10 21:38:39 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:38:39 user nova-compute[75285]:   </features>
Nov 10 21:38:39 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:38:39 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:38:39 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:38:39 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:38:39 user nova-compute[75285]:   </clock>
Nov 10 21:38:39 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:38:39 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:38:39 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:38:39 user nova-compute[75285]:   </cpu>
Nov 10 21:38:39 user nova-compute[75285]:   <devices>
Nov 10 21:38:39 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:38:39 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:38:39 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk"/>
Nov 10 21:38:39 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:38:39 user nova-compute[75285]:     </disk>
Nov 10 21:38:39 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:38:39 user nova-compute[75285]:       <mac address="fa:16:3e:e6:36:4b"/>
Nov 10 21:38:39 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:38:39 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:38:39 user nova-compute[75285]:       <target dev="tap61769235-56"/>
Nov 10 21:38:39 user nova-compute[75285]:     </interface>
Nov 10 21:38:39 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:38:39 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/console.log" append="off"/>
Nov 10 21:38:39 user nova-compute[75285]:     </serial>
Nov 10 21:38:39 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:38:39 user nova-compute[75285]:     <video>
Nov 10 21:38:39 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:38:39 user nova-compute[75285]:     </video>
Nov 10 21:38:39 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:38:39 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:38:39 user nova-compute[75285]:     </rng>
Nov 10 21:38:39 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:38:39 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:38:39 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:38:39 user nova-compute[75285]:     </memballoon>
Nov 10 21:38:39 user nova-compute[75285]:   </devices>
Nov 10 21:38:39 user nova-compute[75285]: </domain>
Nov 10 21:38:39 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:38:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-319214058',display_name='tempest-AttachVolumeTestJSON-server-319214058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-319214058',id=44,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ2RIxYCQMmIFfEOoE3epQ9wCXGiCXTB+DEbr0u2kJM6suaYv1+fW6uSJokY+ytRQjKd5GJNarDt5WUBYrsHpI0/A+u95pTYDTpR9WjUsEyZw+GOU6Vag3q5UAUJMEI1w==',key_name='tempest-keypair-209731017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63bf2d92f6524ec0af61667a9f06bc49',ramdisk_id='',reservation_id='r-07iwqlqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-738528264',owner_user_name='tempest-AttachVolumeTestJSON-738528264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780e11dc70f54bf88772860118930629',uuid=b1728988-eadf-468e-9554-ab05b2ddcd4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61769235-563d-492b-9e22-01df85111b5f", "address": "fa:16:3e:e6:36:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61769235-56", "ovs_interfaceid": "61769235-563d-492b-9e22-01df85111b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converting VIF {"id": "61769235-563d-492b-9e22-01df85111b5f", "address": "fa:16:3e:e6:36:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61769235-56", "ovs_interfaceid": "61769235-563d-492b-9e22-01df85111b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=61769235-563d-492b-9e22-01df85111b5f,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61769235-56') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG os_vif [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=61769235-563d-492b-9e22-01df85111b5f,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61769235-56') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32fd2c84-f768-57fa-b02b-b22b9d2a2d92', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61769235-56, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61769235-56, col_values=(('qos', UUID('21dde10e-00fc-49c7-8035-3919afcdf95b')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61769235-56, col_values=(('external_ids', {'iface-id': '61769235-563d-492b-9e22-01df85111b5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:36:4b', 'vm-uuid': 'b1728988-eadf-468e-9554-ab05b2ddcd4c'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:39 user nova-compute[75285]: INFO os_vif [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=61769235-563d-492b-9e22-01df85111b5f,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61769235-56')
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] No VIF found with MAC fa:16:3e:e6:36:4b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.network.neutron [req-eb41676f-1faa-48a5-86eb-24faace993c6 req-5fc4d61f-2ffe-484f-a159-2a72ac77e227 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Updated VIF entry in instance network info cache for port 61769235-563d-492b-9e22-01df85111b5f. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG nova.network.neutron [req-eb41676f-1faa-48a5-86eb-24faace993c6 req-5fc4d61f-2ffe-484f-a159-2a72ac77e227 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Updating instance_info_cache with network_info: [{"id": "61769235-563d-492b-9e22-01df85111b5f", "address": "fa:16:3e:e6:36:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61769235-56", "ovs_interfaceid": "61769235-563d-492b-9e22-01df85111b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:38:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-eb41676f-1faa-48a5-86eb-24faace993c6 req-5fc4d61f-2ffe-484f-a159-2a72ac77e227 service nova] Releasing lock "refresh_cache-b1728988-eadf-468e-9554-ab05b2ddcd4c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:38:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-6ec9479e-d812-41fd-bc77-722bb0b67346 req-a987ccdc-07da-4fcc-b77d-2705c1194874 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Received event network-vif-plugged-61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:38:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6ec9479e-d812-41fd-bc77-722bb0b67346 req-a987ccdc-07da-4fcc-b77d-2705c1194874 service nova] Acquiring lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:38:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6ec9479e-d812-41fd-bc77-722bb0b67346 req-a987ccdc-07da-4fcc-b77d-2705c1194874 service nova] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:38:41 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6ec9479e-d812-41fd-bc77-722bb0b67346 req-a987ccdc-07da-4fcc-b77d-2705c1194874 service nova] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:38:41 user nova-compute[75285]: DEBUG nova.compute.manager [req-6ec9479e-d812-41fd-bc77-722bb0b67346 req-a987ccdc-07da-4fcc-b77d-2705c1194874 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] No waiting events found dispatching network-vif-plugged-61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:38:41 user nova-compute[75285]: WARNING nova.compute.manager [req-6ec9479e-d812-41fd-bc77-722bb0b67346 req-a987ccdc-07da-4fcc-b77d-2705c1194874 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Received unexpected event network-vif-plugged-61769235-563d-492b-9e22-01df85111b5f for instance with vm_state building and task_state spawning.
Nov 10 21:38:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:42 user nova-compute[75285]: DEBUG nova.compute.manager [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:38:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:38:42 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Instance spawned successfully.
Nov 10 21:38:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:38:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:38:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:38:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:38:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:38:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:38:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:38:43 user nova-compute[75285]: INFO nova.compute.manager [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 10 21:38:43 user nova-compute[75285]: DEBUG nova.compute.manager [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:38:43 user nova-compute[75285]: INFO nova.compute.manager [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Took 6.07 seconds to build instance.
Nov 10 21:38:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dc1544c1-d842-4f2b-9be6-66fe297d80b4 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.166s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:38:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-302ab342-3b8d-4d3e-8614-e415f13d4966 req-491079a9-106c-44b2-8cd5-dfcb35f4ad4d service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Received event network-vif-plugged-61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:38:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-302ab342-3b8d-4d3e-8614-e415f13d4966 req-491079a9-106c-44b2-8cd5-dfcb35f4ad4d service nova] Acquiring lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:38:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-302ab342-3b8d-4d3e-8614-e415f13d4966 req-491079a9-106c-44b2-8cd5-dfcb35f4ad4d service nova] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:38:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-302ab342-3b8d-4d3e-8614-e415f13d4966 req-491079a9-106c-44b2-8cd5-dfcb35f4ad4d service nova] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:38:43 user nova-compute[75285]: DEBUG nova.compute.manager [req-302ab342-3b8d-4d3e-8614-e415f13d4966 req-491079a9-106c-44b2-8cd5-dfcb35f4ad4d service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] No waiting events found dispatching network-vif-plugged-61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:38:43 user nova-compute[75285]: WARNING nova.compute.manager [req-302ab342-3b8d-4d3e-8614-e415f13d4966 req-491079a9-106c-44b2-8cd5-dfcb35f4ad4d service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Received unexpected event network-vif-plugged-61769235-563d-492b-9e22-01df85111b5f for instance with vm_state active and task_state None.
Nov 10 21:38:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:38:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:38:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:38:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:38:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:38:58 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:38:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:00 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:39:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 21:39:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] There are 0 instances to clean {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 21:39:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:04 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:39:04 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:39:04 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:39:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:39:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:39:04 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:39:04 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid b50a2144-75e2-4124-9be7-7c5f9a5ce647 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:39:05 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updating instance_info_cache with network_info: [{"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:39:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:39:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:39:06 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:39:06 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:39:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:07 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:39:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:39:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:39:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:39:07 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:39:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZlaQozm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:39:08 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:39:08 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:39:08 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b9980d-a9e7-47de-a13d-1deef5c2b532]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:39:08 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[039c3a55-2727-4a70-887a-6a4adb1691f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04] added
Nov 10 21:39:08 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e52890a-761d-472c-b397-372c8723534e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a71e792-9aff-4b59-bf6c-a391bea88ee0]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZlaQozm {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZlaQozm" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[817cfdff-a3d5-4bc0-a3cc-5a2b0a7c4144]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WZlaQozm'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bac3a0e-ca24-4bdd-a635-7949a9e0827d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a536fd-b7a0-430e-9a6c-095dc5c9ddfb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:39:08 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:39:08 user nova-compute[75285]:  {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:39:08 user nova-compute[75285]: WARNING os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 21:39:08 user nova-compute[75285]: 
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa8e8d4-efa1-4ed6-b495-dc20586a6036]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04, portal: 172.16.0.220,3260]
Nov 10 21:39:08 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04, portal: 172.16.0.220,3260] successful.
Nov 10 21:39:08 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada1933d-0976-4bff-a06d-a8020952d26a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c084ac-08ce-4fdc-b94e-d01f2c49784f]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 (non-flash)
Nov 10 21:39:08 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 (non-flash)
Nov 10 21:39:08 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2a48bd-b809-4a73-af1e-49a436b81497]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZlaQozm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:09 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:39:09 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8671MB free_disk=25.020523071289062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance fbec82a1-7e08-4ccb-a2a8-ff250d507110 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance b1728988-eadf-468e-9554-ab05b2ddcd4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing inventories for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating ProviderTree inventory for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating inventory in ProviderTree for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing aggregate associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, aggregates: None {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26665343832313861', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665343832313861', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lazy-loading 'flavor' on Instance uuid b50a2144-75e2-4124-9be7-7c5f9a5ce647 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:39:09 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:39:09 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:39:09 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:39:09 user nova-compute[75285]:   <serial>9d22dbd1-af56-439f-b832-0577a5e2ae04</serial>
Nov 10 21:39:09 user nova-compute[75285]: </disk>
Nov 10 21:39:09 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing trait associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:39:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:39:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:39:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:39:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] No VIF found with MAC fa:16:3e:7e:50:9b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:39:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c037b0d6-bd69-42b8-84be-ee593cc7d44f tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.023s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:39:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:39:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:39:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:39:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:39:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:39:12 user nova-compute[75285]: INFO nova.compute.manager [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Detaching volume 9d22dbd1-af56-439f-b832-0577a5e2ae04
Nov 10 21:39:12 user nova-compute[75285]: INFO nova.virt.block_device [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Attempting to driver detach volume 9d22dbd1-af56-439f-b832-0577a5e2ae04 from mountpoint /dev/vdb
Nov 10 21:39:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Attempting to detach device vdb from instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:39:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:39:12 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:39:12 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:39:12 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:39:12 user nova-compute[75285]:   <serial>9d22dbd1-af56-439f-b832-0577a5e2ae04</serial>
Nov 10 21:39:12 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:39:12 user nova-compute[75285]: </disk>
Nov 10 21:39:12 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:39:12 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Successfully detached device vdb from instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 from the persistent domain config.
Nov 10 21:39:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:39:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:39:12 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:39:12 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:39:12 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:39:12 user nova-compute[75285]:   <serial>9d22dbd1-af56-439f-b832-0577a5e2ae04</serial>
Nov 10 21:39:12 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:39:12 user nova-compute[75285]: </disk>
Nov 10 21:39:12 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:39:12 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:39:12 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:39:12 user nova-compute[75285]: DEBUG nova.compute.manager [req-ab64ab1f-12fd-44a1-a35e-9c0d81b315e5 req-b32b0f7a-6b60-4d17-ae9c-2496a2d6afa4 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Received event network-changed-dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:39:12 user nova-compute[75285]: DEBUG nova.compute.manager [req-ab64ab1f-12fd-44a1-a35e-9c0d81b315e5 req-b32b0f7a-6b60-4d17-ae9c-2496a2d6afa4 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Refreshing instance network info cache due to event network-changed-dc9a3797-4ebe-4970-bae9-fb4fa212c605. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:39:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ab64ab1f-12fd-44a1-a35e-9c0d81b315e5 req-b32b0f7a-6b60-4d17-ae9c-2496a2d6afa4 service nova] Acquiring lock "refresh_cache-fbec82a1-7e08-4ccb-a2a8-ff250d507110" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:39:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ab64ab1f-12fd-44a1-a35e-9c0d81b315e5 req-b32b0f7a-6b60-4d17-ae9c-2496a2d6afa4 service nova] Acquired lock "refresh_cache-fbec82a1-7e08-4ccb-a2a8-ff250d507110" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:39:12 user nova-compute[75285]: DEBUG nova.network.neutron [req-ab64ab1f-12fd-44a1-a35e-9c0d81b315e5 req-b32b0f7a-6b60-4d17-ae9c-2496a2d6afa4 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Refreshing network info cache for port dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:39:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:39:13 user nova-compute[75285]: DEBUG nova.network.neutron [req-ab64ab1f-12fd-44a1-a35e-9c0d81b315e5 req-b32b0f7a-6b60-4d17-ae9c-2496a2d6afa4 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Updated VIF entry in instance network info cache for port dc9a3797-4ebe-4970-bae9-fb4fa212c605. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:39:13 user nova-compute[75285]: DEBUG nova.network.neutron [req-ab64ab1f-12fd-44a1-a35e-9c0d81b315e5 req-b32b0f7a-6b60-4d17-ae9c-2496a2d6afa4 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Updating instance_info_cache with network_info: [{"id": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "address": "fa:16:3e:6b:92:7c", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc9a3797-4e", "ovs_interfaceid": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:39:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ab64ab1f-12fd-44a1-a35e-9c0d81b315e5 req-b32b0f7a-6b60-4d17-ae9c-2496a2d6afa4 service nova] Releasing lock "refresh_cache-fbec82a1-7e08-4ccb-a2a8-ff250d507110" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:39:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:39:16 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_power_states {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:39:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid b50a2144-75e2-4124-9be7-7c5f9a5ce647 {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:39:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid fbec82a1-7e08-4ccb-a2a8-ff250d507110 {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:39:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid b1728988-eadf-468e-9554-ab05b2ddcd4c {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:39:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:39:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:39:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:39:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:39:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:39:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:39:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:39:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:18 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:39:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:39:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:39:19 user nova-compute[75285]: DEBUG nova.objects.instance [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lazy-loading 'flavor' on Instance uuid fbec82a1-7e08-4ccb-a2a8-ff250d507110 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:39:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:39:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:39:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:39:19 user nova-compute[75285]: INFO nova.compute.manager [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Attaching volume 01696096-25d1-42ff-b1b5-c2dea56c026b to /dev/vdb
Nov 10 21:39:19 user nova-compute[75285]: DEBUG os_brick.utils [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:39:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[559566aa-56be-4261-8c37-4dee13fb0ce1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c602308-f61e-4a7e-b857-5bcdbaccea17]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55140c1-631e-4fb8-9467-5454b488a59e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0c1451-dd60-4b82-8ea3-6355fb755b6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:39:20 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:39:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[02253371-da81-4169-9a35-d806ea483746]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG os_brick.utils [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:39:20 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Updating existing volume attachment record: c68ce7a6-204e-41d1-a2ee-5f2c65880bbf {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:39:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:27 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:39:27 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances with incomplete migration  {{(pid=75285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 21:39:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:39:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:39:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:39:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:39:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:32 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 is timed out.
Nov 10 21:39:32 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Successfully detached device vdb from instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 from the live domain config.
Nov 10 21:39:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:39:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZlaQozm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:39:32 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:39:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:39:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:39:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0faf12-c064-490a-a9af-33224775e7ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:39:32 user nova-compute[75285]: No targets found.
Nov 10 21:39:32 user nova-compute[75285]: iSNS:
Nov 10 21:39:32 user nova-compute[75285]: No targets found.
Nov 10 21:39:32 user nova-compute[75285]: STATIC:
Nov 10 21:39:32 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04
Nov 10 21:39:32 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:39:32 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:39:32 user nova-compute[75285]: FIRMWARE:
Nov 10 21:39:32 user nova-compute[75285]: No targets found.
Nov 10 21:39:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:39:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:39:32 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:39:32 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:39:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:39:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f50ee36-efda-4ecf-93fc-5e0cf7197758]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedd5fc9-ca15-42e3-9f50-34e253fdbf32]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 (non-flash)
Nov 10 21:39:33 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 (non-flash)
Nov 10 21:39:33 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e43431c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e89e137-c692-452b-9953-f6815c18a81f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[840679c2-4b82-444c-802d-ca82f2eb3775]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e27f7f1-0534-40c4-ad8f-d0486f33700b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f9a594-d03e-4340-9408-7b1d71d72eea]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[131b9b8f-cff6-48a2-865b-d36fd316b4b7]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1fc5bc-e76d-4e6a-891b-fa5edea6450f]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04, portal: 172.16.0.220,3260]
Nov 10 21:39:33 user nova-compute[75285]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04, portal: 172.16.0.220,3260] successful.
Nov 10 21:39:33 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d22dbd1-af56-439f-b832-0577a5e2ae04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58a2539-471b-4f13-af4a-0ce8d8198461]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] <== disconnect_volume: return (295ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:39:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:39:34 user nova-compute[75285]: DEBUG nova.objects.instance [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lazy-loading 'flavor' on Instance uuid b50a2144-75e2-4124-9be7-7c5f9a5ce647 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:39:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e46335ec-5a05-430c-91b4-10c3548866ca tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.942s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:39:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 17.479s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:39:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:39:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:39:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:39:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:39:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:39:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puBhdtTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:39:44 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:39:44 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:39:44 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dff507-cdc0-40f1-8c24-9cd21909fd09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:39:44 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3583593-7401-4e6b-87f6-712c2a050e9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b] added
Nov 10 21:39:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4683ca86-2521-4702-b51a-47b4ca34fa31]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[51406e3e-f4fd-4fbf-a84c-67ae5ceb2ebe]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v puBhdtTY {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v puBhdtTY" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1270b06-575c-4f5a-a89d-6c80e37d5a0c]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'puBhdtTY'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dc41c1-6039-4cfc-9916-0795cd158661]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dabb41-acb3-4312-86b9-f79ba242c600]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:39:44 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:39:44 user nova-compute[75285]:  {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:39:44 user nova-compute[75285]: WARNING os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 21:39:44 user nova-compute[75285]: 
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ba5143-8a50-4ef7-a938-3e141a1bda4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b, portal: 172.16.0.220,3260]
Nov 10 21:39:44 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b, portal: 172.16.0.220,3260] successful.
Nov 10 21:39:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee6e1ff-ad26-4ee2-8053-ed71302e5a1a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9320ac66-261c-4251-a0c3-a5a789b3cc50]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b (non-flash)
Nov 10 21:39:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b (non-flash)
Nov 10 21:39:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8136aa-ee0d-4938-b96d-0325ea885652]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puBhdtTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:39:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:39:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26661323866303365', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:39:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661323866303365', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:39:45 user nova-compute[75285]: DEBUG nova.objects.instance [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lazy-loading 'flavor' on Instance uuid fbec82a1-7e08-4ccb-a2a8-ff250d507110 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:39:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:39:45 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:39:45 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:39:45 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:39:45 user nova-compute[75285]:   <serial>01696096-25d1-42ff-b1b5-c2dea56c026b</serial>
Nov 10 21:39:45 user nova-compute[75285]: </disk>
Nov 10 21:39:45 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:39:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:39:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:39:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] No VIF found with MAC fa:16:3e:6b:92:7c, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:39:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1960b83e-c012-409c-b5f1-8415528a6c48 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.024s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:39:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:39:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:39:47 user nova-compute[75285]: INFO nova.compute.manager [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Detaching volume 01696096-25d1-42ff-b1b5-c2dea56c026b
Nov 10 21:39:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:47 user nova-compute[75285]: INFO nova.virt.block_device [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Attempting to driver detach volume 01696096-25d1-42ff-b1b5-c2dea56c026b from mountpoint /dev/vdb
Nov 10 21:39:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Attempting to detach device vdb from instance fbec82a1-7e08-4ccb-a2a8-ff250d507110 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:39:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:39:47 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:39:47 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:39:47 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:39:47 user nova-compute[75285]:   <serial>01696096-25d1-42ff-b1b5-c2dea56c026b</serial>
Nov 10 21:39:47 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:39:47 user nova-compute[75285]: </disk>
Nov 10 21:39:47 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:39:47 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Successfully detached device vdb from instance fbec82a1-7e08-4ccb-a2a8-ff250d507110 from the persistent domain config.
Nov 10 21:39:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fbec82a1-7e08-4ccb-a2a8-ff250d507110 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:39:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:39:47 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:39:47 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:39:47 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:39:47 user nova-compute[75285]:   <serial>01696096-25d1-42ff-b1b5-c2dea56c026b</serial>
Nov 10 21:39:47 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:39:47 user nova-compute[75285]: </disk>
Nov 10 21:39:47 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:39:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fbec82a1-7e08-4ccb-a2a8-ff250d507110 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:39:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:57 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:39:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:39:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:06 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:40:06 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:40:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-fbec82a1-7e08-4ccb-a2a8-ff250d507110" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:40:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-fbec82a1-7e08-4ccb-a2a8-ff250d507110" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:40:06 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Updating instance_info_cache with network_info: [{"id": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "address": "fa:16:3e:6b:92:7c", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc9a3797-4e", "ovs_interfaceid": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-fbec82a1-7e08-4ccb-a2a8-ff250d507110" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:07 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fbec82a1-7e08-4ccb-a2a8-ff250d507110 is timed out.
Nov 10 21:40:07 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Successfully detached device vdb from instance fbec82a1-7e08-4ccb-a2a8-ff250d507110 from the live domain config.
Nov 10 21:40:07 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puBhdtTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:40:07 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71bf4ac-0d10-4b69-a042-092abec0f28c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:40:07 user nova-compute[75285]: No targets found.
Nov 10 21:40:07 user nova-compute[75285]: iSNS:
Nov 10 21:40:07 user nova-compute[75285]: No targets found.
Nov 10 21:40:07 user nova-compute[75285]: STATIC:
Nov 10 21:40:07 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b
Nov 10 21:40:07 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:40:07 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:40:07 user nova-compute[75285]: FIRMWARE:
Nov 10 21:40:07 user nova-compute[75285]: No targets found.
Nov 10 21:40:07 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:40:07 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:40:07 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5943a54c-d187-4f12-9db4-90c116b50a48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f834fbc-dbc6-4d1e-941b-18e00c07015c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b (non-flash)
Nov 10 21:40:07 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b (non-flash)
Nov 10 21:40:07 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e44dfbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80fa0b8-dc93-453e-a74f-1cef2ff54022]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0916091-a339-4816-bcb1-e14bf41bba29]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e979ee74-0153-4469-a5c2-a66a6df80acd]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2852095c-3270-4e44-9321-8ade676c3898]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:40:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb4885e-556f-4544-bb83-aaac9552de60]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:40:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d8175a-8966-4804-aef8-925de6a21014]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b, portal: 172.16.0.220,3260]
Nov 10 21:40:08 user nova-compute[75285]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b, portal: 172.16.0.220,3260] successful.
Nov 10 21:40:08 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:40:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01696096-25d1-42ff-b1b5-c2dea56c026b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[16da3463-a17a-4267-9799-9468acdef285]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:40:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:40:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] <== disconnect_volume: return (280ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:40:08 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:40:09 user nova-compute[75285]: DEBUG nova.objects.instance [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lazy-loading 'flavor' on Instance uuid fbec82a1-7e08-4ccb-a2a8-ff250d507110 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:40:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d735d23a-cc07-4428-a202-1b6fb31f6133 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.054s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:40:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:40:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:40:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:40:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:09 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:40:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:11 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:40:11 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:40:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8701MB free_disk=25.016613006591797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:40:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:40:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance fbec82a1-7e08-4ccb-a2a8-ff250d507110 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:40:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance b1728988-eadf-468e-9554-ab05b2ddcd4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:40:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:40:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:40:11 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:40:11 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:40:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:40:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:40:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:40:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:40:15 user nova-compute[75285]: INFO nova.compute.manager [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] instance snapshotting
Nov 10 21:40:15 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Beginning live snapshot process
Nov 10 21:40:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json -f qcow2 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json -f qcow2 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.170s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnheq3dmx/e07a24fcfbf74b8f9a420f235738ace8.delta 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnheq3dmx/e07a24fcfbf74b8f9a420f235738ace8.delta 1073741824" returned: 0 in 0.060s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:16 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 21:40:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:40:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75563008 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:40:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 21:40:17 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 21:40:17 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:40:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnheq3dmx/e07a24fcfbf74b8f9a420f235738ace8.delta /opt/stack/data/nova/instances/snapshots/tmpnheq3dmx/e07a24fcfbf74b8f9a420f235738ace8 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnheq3dmx/e07a24fcfbf74b8f9a420f235738ace8.delta /opt/stack/data/nova/instances/snapshots/tmpnheq3dmx/e07a24fcfbf74b8f9a420f235738ace8" returned: 0 in 0.735s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:18 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Snapshot extracted, beginning image upload
Nov 10 21:40:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:21 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Snapshot image upload complete
Nov 10 21:40:21 user nova-compute[75285]: INFO nova.compute.manager [None req-6d840730-dbc3-4f02-859d-89ac62379afb tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Took 5.82 seconds to snapshot the instance on the hypervisor.
Nov 10 21:40:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "3de2a41a-da2d-4531-a996-b57a637e163b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "3de2a41a-da2d-4531-a996-b57a637e163b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:23 user nova-compute[75285]: DEBUG nova.compute.manager [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:40:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:23 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:40:23 user nova-compute[75285]: INFO nova.compute.claims [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Claim successful on node user
Nov 10 21:40:23 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:40:23 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:40:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:23 user nova-compute[75285]: DEBUG nova.compute.manager [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:40:23 user nova-compute[75285]: DEBUG nova.compute.manager [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:40:23 user nova-compute[75285]: DEBUG nova.network.neutron [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:40:23 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:40:23 user nova-compute[75285]: DEBUG nova.compute.manager [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:40:24 user nova-compute[75285]: DEBUG nova.policy [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b47da8e21f44b98aec923a5bf71b361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362608e7cf3b4c1fb9dc6187091b3dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:40:24 user nova-compute[75285]: DEBUG nova.compute.manager [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:40:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:40:24 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Creating image(s)
Nov 10 21:40:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "/opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "/opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "/opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "bf52824a7589b103c7686696d2fa7851fed19622" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "bf52824a7589b103c7686696d2fa7851fed19622" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622.part --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:25 user nova-compute[75285]: DEBUG nova.network.neutron [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Successfully created port: 7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:40:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622.part --force-share --output=json" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:25 user nova-compute[75285]: DEBUG nova.virt.images [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] b45ea9b8-79d0-4bd0-972e-63d6917fe8ed was qcow2, converting to raw {{(pid=75285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 21:40:25 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:40:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622.part /opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622.converted {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:25 user nova-compute[75285]: DEBUG nova.compute.manager [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622.part /opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622.converted" returned: 0 in 0.485s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622.converted --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:40:26 user nova-compute[75285]: INFO nova.compute.claims [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Claim successful on node user
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "bf52824a7589b103c7686696d2fa7851fed19622" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.217s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG nova.network.neutron [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Successfully updated port: 7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquired lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG nova.network.neutron [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622 --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "bf52824a7589b103c7686696d2fa7851fed19622" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "bf52824a7589b103c7686696d2fa7851fed19622" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG nova.compute.manager [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-bc9f88ac-1819-47db-92cf-52943e32c9aa req-f9ce2600-859f-4334-a20c-e29c8f342541 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Received event network-changed-7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG nova.compute.manager [req-bc9f88ac-1819-47db-92cf-52943e32c9aa req-f9ce2600-859f-4334-a20c-e29c8f342541 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Refreshing instance network info cache due to event network-changed-7e91a41b-b901-4e3f-9b04-f81f014d7276. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bc9f88ac-1819-47db-92cf-52943e32c9aa req-f9ce2600-859f-4334-a20c-e29c8f342541 service nova] Acquiring lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG nova.network.neutron [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG nova.compute.manager [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG nova.network.neutron [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:40:26 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:40:26 user nova-compute[75285]: DEBUG nova.compute.manager [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622 --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622,backing_fmt=raw /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:26 user nova-compute[75285]: INFO nova.virt.block_device [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Booting with volume 8a7c5a89-9fff-423a-b0f0-ce6c402ce01c at /dev/vda
Nov 10 21:40:26 user nova-compute[75285]: DEBUG nova.policy [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4e52746b7f24c08a3e1dae6e115b577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4dfd5b630c34fd7a61e8db5a71a60f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622,backing_fmt=raw /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk 1073741824" returned: 0 in 0.066s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "bf52824a7589b103c7686696d2fa7851fed19622" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG os_brick.utils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd503a0-63d2-4df3-bb53-adbbef8ae1f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7162e696-67f7-487c-aabf-16b4de9bfe30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c9efc1-097e-4ec1-bc4f-378ca9a0cfb7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0008b0e-e471-4df8-822e-7aa5494a6b04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf52824a7589b103c7686696d2fa7851fed19622 --force-share --output=json" returned: 0 in 0.219s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Ensure instance console log exists: /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:40:27 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:40:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a134d5f-dd7f-4382-89e1-0b3b67b58fe2]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG os_brick.utils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updating existing volume attachment record: 03083eb9-3ed3-471f-ad60-95aacacab30b {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.network.neutron [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Updating instance_info_cache with network_info: [{"id": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "address": "fa:16:3e:2b:6c:8d", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e91a41b-b9", "ovs_interfaceid": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Releasing lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.compute.manager [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Instance network_info: |[{"id": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "address": "fa:16:3e:2b:6c:8d", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e91a41b-b9", "ovs_interfaceid": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bc9f88ac-1819-47db-92cf-52943e32c9aa req-f9ce2600-859f-4334-a20c-e29c8f342541 service nova] Acquired lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.network.neutron [req-bc9f88ac-1819-47db-92cf-52943e32c9aa req-f9ce2600-859f-4334-a20c-e29c8f342541 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Refreshing network info cache for port 7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Start _get_guest_xml network_info=[{"id": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "address": "fa:16:3e:2b:6c:8d", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e91a41b-b9", "ovs_interfaceid": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='06d6cbfe646b80c2df1cb859ac319212',container_format='bare',created_at=2023-11-10T21:40:15Z,direct_url=<?>,disk_format='qcow2',id=b45ea9b8-79d0-4bd0-972e-63d6917fe8ed,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1542406977',owner='362608e7cf3b4c1fb9dc6187091b3dbb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T21:40:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b45ea9b8-79d0-4bd0-972e-63d6917fe8ed'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:40:27 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:40:27 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='06d6cbfe646b80c2df1cb859ac319212',container_format='bare',created_at=2023-11-10T21:40:15Z,direct_url=<?>,disk_format='qcow2',id=b45ea9b8-79d0-4bd0-972e-63d6917fe8ed,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1542406977',owner='362608e7cf3b4c1fb9dc6187091b3dbb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T21:40:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:40:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-81119561',display_name='tempest-TestStampPattern-server-81119561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-81119561',id=45,image_ref='b45ea9b8-79d0-4bd0-972e-63d6917fe8ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDesKwnov6nE2ld9TlR2fU3g0q2iM+VKiUlmhK8jP1iPmNHB6lDKQy4ay9Gx6aPViDAsMciHIGIxIzSorT0IkxMhTgbfUY9SEgK+3RievcFZ227mhE1qSONbcnrF6fHmFg==',key_name='tempest-TestStampPattern-930691110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='362608e7cf3b4c1fb9dc6187091b3dbb',ramdisk_id='',reservation_id='r-nxdd4xgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b50a2144-75e2-4124-9be7-7c5f9a5ce647',image_min_disk='1',image_min_ram='0',image_owner_id='362608e7cf3b4c1fb9dc6187091b3dbb',image_owner_project_name='tempest-TestStampPattern-248662818',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-248662818-project-member',image_user_id='4b47da8e21f44b98aec923a5bf71b361',network_allocated='True',owner_project_name='tempest-TestStampPattern-248662818',owner_user_name='tempest-TestStampPattern-248662818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:40:24Z,user_data=None,user_id='4b47da8e21f44b98aec923a5bf71b361',uuid=3de2a41a-da2d-4531-a996-b57a637e163b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "address": "fa:16:3e:2b:6c:8d", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e91a41b-b9", "ovs_interfaceid": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Converting VIF {"id": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "address": "fa:16:3e:2b:6c:8d", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e91a41b-b9", "ovs_interfaceid": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:6c:8d,bridge_name='br-int',has_traffic_filtering=True,id=7e91a41b-b901-4e3f-9b04-f81f014d7276,network=Network(f2a1706e-9d15-46ca-93a2-9fb70223a9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e91a41b-b9') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.objects.instance [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lazy-loading 'pci_devices' on Instance uuid 3de2a41a-da2d-4531-a996-b57a637e163b {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:40:27 user nova-compute[75285]:   <uuid>3de2a41a-da2d-4531-a996-b57a637e163b</uuid>
Nov 10 21:40:27 user nova-compute[75285]:   <name>instance-0000002d</name>
Nov 10 21:40:27 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:40:27 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:40:27 user nova-compute[75285]:   <metadata>
Nov 10 21:40:27 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:40:27 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:40:27 user nova-compute[75285]:       <nova:name>tempest-TestStampPattern-server-81119561</nova:name>
Nov 10 21:40:27 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:40:27</nova:creationTime>
Nov 10 21:40:27 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:40:27 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:40:27 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:40:27 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:40:27 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:40:27 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:40:27 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:40:27 user nova-compute[75285]:       <nova:owner>
Nov 10 21:40:27 user nova-compute[75285]:         <nova:user uuid="4b47da8e21f44b98aec923a5bf71b361">tempest-TestStampPattern-248662818-project-member</nova:user>
Nov 10 21:40:27 user nova-compute[75285]:         <nova:project uuid="362608e7cf3b4c1fb9dc6187091b3dbb">tempest-TestStampPattern-248662818</nova:project>
Nov 10 21:40:27 user nova-compute[75285]:       </nova:owner>
Nov 10 21:40:27 user nova-compute[75285]:       <nova:root type="image" uuid="b45ea9b8-79d0-4bd0-972e-63d6917fe8ed"/>
Nov 10 21:40:27 user nova-compute[75285]:       <nova:ports>
Nov 10 21:40:27 user nova-compute[75285]:         <nova:port uuid="7e91a41b-b901-4e3f-9b04-f81f014d7276">
Nov 10 21:40:27 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 21:40:27 user nova-compute[75285]:         </nova:port>
Nov 10 21:40:27 user nova-compute[75285]:       </nova:ports>
Nov 10 21:40:27 user nova-compute[75285]:     </nova:instance>
Nov 10 21:40:27 user nova-compute[75285]:   </metadata>
Nov 10 21:40:27 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:40:27 user nova-compute[75285]:     <system>
Nov 10 21:40:27 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:40:27 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:40:27 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:40:27 user nova-compute[75285]:       <entry name="serial">3de2a41a-da2d-4531-a996-b57a637e163b</entry>
Nov 10 21:40:27 user nova-compute[75285]:       <entry name="uuid">3de2a41a-da2d-4531-a996-b57a637e163b</entry>
Nov 10 21:40:27 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:40:27 user nova-compute[75285]:     </system>
Nov 10 21:40:27 user nova-compute[75285]:   </sysinfo>
Nov 10 21:40:27 user nova-compute[75285]:   <os>
Nov 10 21:40:27 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:40:27 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:40:27 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:40:27 user nova-compute[75285]:   </os>
Nov 10 21:40:27 user nova-compute[75285]:   <features>
Nov 10 21:40:27 user nova-compute[75285]:     <acpi/>
Nov 10 21:40:27 user nova-compute[75285]:     <apic/>
Nov 10 21:40:27 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:40:27 user nova-compute[75285]:   </features>
Nov 10 21:40:27 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:40:27 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:40:27 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:40:27 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:40:27 user nova-compute[75285]:   </clock>
Nov 10 21:40:27 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:40:27 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:40:27 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:40:27 user nova-compute[75285]:   </cpu>
Nov 10 21:40:27 user nova-compute[75285]:   <devices>
Nov 10 21:40:27 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:40:27 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:40:27 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk"/>
Nov 10 21:40:27 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:40:27 user nova-compute[75285]:     </disk>
Nov 10 21:40:27 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:40:27 user nova-compute[75285]:       <mac address="fa:16:3e:2b:6c:8d"/>
Nov 10 21:40:27 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:40:27 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:40:27 user nova-compute[75285]:       <target dev="tap7e91a41b-b9"/>
Nov 10 21:40:27 user nova-compute[75285]:     </interface>
Nov 10 21:40:27 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:40:27 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/console.log" append="off"/>
Nov 10 21:40:27 user nova-compute[75285]:     </serial>
Nov 10 21:40:27 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:40:27 user nova-compute[75285]:     <video>
Nov 10 21:40:27 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:40:27 user nova-compute[75285]:     </video>
Nov 10 21:40:27 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:40:27 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:40:27 user nova-compute[75285]:     </rng>
Nov 10 21:40:27 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:40:27 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:40:27 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:40:27 user nova-compute[75285]:     </memballoon>
Nov 10 21:40:27 user nova-compute[75285]:   </devices>
Nov 10 21:40:27 user nova-compute[75285]: </domain>
Nov 10 21:40:27 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:40:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-81119561',display_name='tempest-TestStampPattern-server-81119561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-81119561',id=45,image_ref='b45ea9b8-79d0-4bd0-972e-63d6917fe8ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDesKwnov6nE2ld9TlR2fU3g0q2iM+VKiUlmhK8jP1iPmNHB6lDKQy4ay9Gx6aPViDAsMciHIGIxIzSorT0IkxMhTgbfUY9SEgK+3RievcFZ227mhE1qSONbcnrF6fHmFg==',key_name='tempest-TestStampPattern-930691110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='362608e7cf3b4c1fb9dc6187091b3dbb',ramdisk_id='',reservation_id='r-nxdd4xgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b50a2144-75e2-4124-9be7-7c5f9a5ce647',image_min_disk='1',image_min_ram='0',image_owner_id='362608e7cf3b4c1fb9dc6187091b3dbb',image_owner_project_name='tempest-TestStampPattern-248662818',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-248662818-project-member',image_user_id='4b47da8e21f44b98aec923a5bf71b361',network_allocated='True',owner_project_name='tempest-TestStampPattern-248662818',owner_user_name='tempest-TestStampPattern-248662818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:40:24Z,user_data=None,user_id='4b47da8e21f44b98aec923a5bf71b361',uuid=3de2a41a-da2d-4531-a996-b57a637e163b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "address": "fa:16:3e:2b:6c:8d", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e91a41b-b9", "ovs_interfaceid": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Converting VIF {"id": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "address": "fa:16:3e:2b:6c:8d", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e91a41b-b9", "ovs_interfaceid": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:6c:8d,bridge_name='br-int',has_traffic_filtering=True,id=7e91a41b-b901-4e3f-9b04-f81f014d7276,network=Network(f2a1706e-9d15-46ca-93a2-9fb70223a9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e91a41b-b9') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG os_vif [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:6c:8d,bridge_name='br-int',has_traffic_filtering=True,id=7e91a41b-b901-4e3f-9b04-f81f014d7276,network=Network(f2a1706e-9d15-46ca-93a2-9fb70223a9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e91a41b-b9') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98d46f44-f578-5065-8c89-0c9157a38101', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e91a41b-b9, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e91a41b-b9, col_values=(('qos', UUID('1e129855-d0a7-42b2-9014-4cdbc2f89b27')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e91a41b-b9, col_values=(('external_ids', {'iface-id': '7e91a41b-b901-4e3f-9b04-f81f014d7276', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:6c:8d', 'vm-uuid': '3de2a41a-da2d-4531-a996-b57a637e163b'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:27 user nova-compute[75285]: INFO os_vif [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:6c:8d,bridge_name='br-int',has_traffic_filtering=True,id=7e91a41b-b901-4e3f-9b04-f81f014d7276,network=Network(f2a1706e-9d15-46ca-93a2-9fb70223a9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e91a41b-b9')
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] No VIF found with MAC fa:16:3e:2b:6c:8d, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.network.neutron [req-bc9f88ac-1819-47db-92cf-52943e32c9aa req-f9ce2600-859f-4334-a20c-e29c8f342541 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Updated VIF entry in instance network info cache for port 7e91a41b-b901-4e3f-9b04-f81f014d7276. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG nova.network.neutron [req-bc9f88ac-1819-47db-92cf-52943e32c9aa req-f9ce2600-859f-4334-a20c-e29c8f342541 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Updating instance_info_cache with network_info: [{"id": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "address": "fa:16:3e:2b:6c:8d", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e91a41b-b9", "ovs_interfaceid": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:40:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bc9f88ac-1819-47db-92cf-52943e32c9aa req-f9ce2600-859f-4334-a20c-e29c8f342541 service nova] Releasing lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:40:28 user nova-compute[75285]: DEBUG nova.network.neutron [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Successfully created port: 417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:40:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d6aa9f7-4222-4456-ae39-fdf6a3211f0a req-0a90630b-0de8-465b-b39a-3405f9ca0844 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Received event network-changed-61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:40:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-1d6aa9f7-4222-4456-ae39-fdf6a3211f0a req-0a90630b-0de8-465b-b39a-3405f9ca0844 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Refreshing instance network info cache due to event network-changed-61769235-563d-492b-9e22-01df85111b5f. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:40:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d6aa9f7-4222-4456-ae39-fdf6a3211f0a req-0a90630b-0de8-465b-b39a-3405f9ca0844 service nova] Acquiring lock "refresh_cache-b1728988-eadf-468e-9554-ab05b2ddcd4c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:40:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d6aa9f7-4222-4456-ae39-fdf6a3211f0a req-0a90630b-0de8-465b-b39a-3405f9ca0844 service nova] Acquired lock "refresh_cache-b1728988-eadf-468e-9554-ab05b2ddcd4c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:40:28 user nova-compute[75285]: DEBUG nova.network.neutron [req-1d6aa9f7-4222-4456-ae39-fdf6a3211f0a req-0a90630b-0de8-465b-b39a-3405f9ca0844 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Refreshing network info cache for port 61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:40:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:28 user nova-compute[75285]: DEBUG nova.network.neutron [req-1d6aa9f7-4222-4456-ae39-fdf6a3211f0a req-0a90630b-0de8-465b-b39a-3405f9ca0844 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Updated VIF entry in instance network info cache for port 61769235-563d-492b-9e22-01df85111b5f. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:40:28 user nova-compute[75285]: DEBUG nova.network.neutron [req-1d6aa9f7-4222-4456-ae39-fdf6a3211f0a req-0a90630b-0de8-465b-b39a-3405f9ca0844 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Updating instance_info_cache with network_info: [{"id": "61769235-563d-492b-9e22-01df85111b5f", "address": "fa:16:3e:e6:36:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61769235-56", "ovs_interfaceid": "61769235-563d-492b-9e22-01df85111b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:40:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1d6aa9f7-4222-4456-ae39-fdf6a3211f0a req-0a90630b-0de8-465b-b39a-3405f9ca0844 service nova] Releasing lock "refresh_cache-b1728988-eadf-468e-9554-ab05b2ddcd4c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG nova.network.neutron [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Successfully updated port: 417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquired lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG nova.network.neutron [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-3d6e1237-6d64-4542-aba5-a06baaa47381 req-bedc812a-df08-4bc1-8392-f77efdc483bd service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-changed-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-3d6e1237-6d64-4542-aba5-a06baaa47381 req-bedc812a-df08-4bc1-8392-f77efdc483bd service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Refreshing instance network info cache due to event network-changed-417a97b9-597b-430c-a7d4-5f66fe232e14. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3d6e1237-6d64-4542-aba5-a06baaa47381 req-bedc812a-df08-4bc1-8392-f77efdc483bd service nova] Acquiring lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG nova.network.neutron [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG nova.network.neutron [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updating instance_info_cache with network_info: [{"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Releasing lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG nova.compute.manager [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Instance network_info: |[{"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3d6e1237-6d64-4542-aba5-a06baaa47381 req-bedc812a-df08-4bc1-8392-f77efdc483bd service nova] Acquired lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG nova.network.neutron [req-3d6e1237-6d64-4542-aba5-a06baaa47381 req-bedc812a-df08-4bc1-8392-f77efdc483bd service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Refreshing network info cache for port 417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG nova.network.neutron [req-3d6e1237-6d64-4542-aba5-a06baaa47381 req-bedc812a-df08-4bc1-8392-f77efdc483bd service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updated VIF entry in instance network info cache for port 417a97b9-597b-430c-a7d4-5f66fe232e14. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG nova.network.neutron [req-3d6e1237-6d64-4542-aba5-a06baaa47381 req-bedc812a-df08-4bc1-8392-f77efdc483bd service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updating instance_info_cache with network_info: [{"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:40:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3d6e1237-6d64-4542-aba5-a06baaa47381 req-bedc812a-df08-4bc1-8392-f77efdc483bd service nova] Releasing lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:40:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-229045da-4ec7-43ca-b030-2674d17b2084 req-7689404d-2b55-4867-979e-aaf9b804ae2f service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Received event network-vif-plugged-7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:40:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-229045da-4ec7-43ca-b030-2674d17b2084 req-7689404d-2b55-4867-979e-aaf9b804ae2f service nova] Acquiring lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-229045da-4ec7-43ca-b030-2674d17b2084 req-7689404d-2b55-4867-979e-aaf9b804ae2f service nova] Lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-229045da-4ec7-43ca-b030-2674d17b2084 req-7689404d-2b55-4867-979e-aaf9b804ae2f service nova] Lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-229045da-4ec7-43ca-b030-2674d17b2084 req-7689404d-2b55-4867-979e-aaf9b804ae2f service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] No waiting events found dispatching network-vif-plugged-7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:40:30 user nova-compute[75285]: WARNING nova.compute.manager [req-229045da-4ec7-43ca-b030-2674d17b2084 req-7689404d-2b55-4867-979e-aaf9b804ae2f service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Received unexpected event network-vif-plugged-7e91a41b-b901-4e3f-9b04-f81f014d7276 for instance with vm_state building and task_state spawning.
Nov 10 21:40:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-229045da-4ec7-43ca-b030-2674d17b2084 req-7689404d-2b55-4867-979e-aaf9b804ae2f service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Received event network-vif-plugged-7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:40:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-229045da-4ec7-43ca-b030-2674d17b2084 req-7689404d-2b55-4867-979e-aaf9b804ae2f service nova] Acquiring lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-229045da-4ec7-43ca-b030-2674d17b2084 req-7689404d-2b55-4867-979e-aaf9b804ae2f service nova] Lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:30 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-229045da-4ec7-43ca-b030-2674d17b2084 req-7689404d-2b55-4867-979e-aaf9b804ae2f service nova] Lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:30 user nova-compute[75285]: DEBUG nova.compute.manager [req-229045da-4ec7-43ca-b030-2674d17b2084 req-7689404d-2b55-4867-979e-aaf9b804ae2f service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] No waiting events found dispatching network-vif-plugged-7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:40:30 user nova-compute[75285]: WARNING nova.compute.manager [req-229045da-4ec7-43ca-b030-2674d17b2084 req-7689404d-2b55-4867-979e-aaf9b804ae2f service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Received unexpected event network-vif-plugged-7e91a41b-b901-4e3f-9b04-f81f014d7276 for instance with vm_state building and task_state spawning.
Nov 10 21:40:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:40:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:40:31 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Instance spawned successfully.
Nov 10 21:40:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:40:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:40:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:40:31 user nova-compute[75285]: INFO nova.compute.manager [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Took 7.20 seconds to spawn the instance on the hypervisor.
Nov 10 21:40:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:40:31 user nova-compute[75285]: INFO nova.compute.manager [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Took 7.86 seconds to build instance.
Nov 10 21:40:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-83348537-2d1d-46e8-964b-69cde9fc99d6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "3de2a41a-da2d-4531-a996-b57a637e163b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.961s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG nova.objects.instance [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'flavor' on Instance uuid b1728988-eadf-468e-9554-ab05b2ddcd4c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:35 user nova-compute[75285]: INFO nova.compute.manager [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Attaching volume 76e47d2f-1fa3-41d2-a901-8ae436cd7f5f to /dev/vdb
Nov 10 21:40:35 user nova-compute[75285]: DEBUG os_brick.utils [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98c80d9-8f7c-43fb-aa5d-d1ee75d6f556]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9166fb5-7e3e-444d-ba5f-e69620c73eff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac3e1d8-191d-422b-9896-63141d6a6fd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6c7979-d236-4d31-8bfa-ae7537eaefcb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:40:35 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:40:35 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfe020d-822e-489b-8e73-ee4494dd14d9]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG os_brick.utils [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:40:35 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Updating existing volume attachment record: 89a00469-537b-4a79-acd9-7969eabdaab6 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:37 user nova-compute[75285]: INFO nova.compute.manager [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Terminating instance
Nov 10 21:40:37 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-d5258c32-14ad-4620-ab58-4c8689cf6257 req-e3ff5f1d-3790-426c-81cf-22245ba6d56a service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Received event network-vif-unplugged-dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d5258c32-14ad-4620-ab58-4c8689cf6257 req-e3ff5f1d-3790-426c-81cf-22245ba6d56a service nova] Acquiring lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d5258c32-14ad-4620-ab58-4c8689cf6257 req-e3ff5f1d-3790-426c-81cf-22245ba6d56a service nova] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-d5258c32-14ad-4620-ab58-4c8689cf6257 req-e3ff5f1d-3790-426c-81cf-22245ba6d56a service nova] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-d5258c32-14ad-4620-ab58-4c8689cf6257 req-e3ff5f1d-3790-426c-81cf-22245ba6d56a service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] No waiting events found dispatching network-vif-unplugged-dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:40:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-d5258c32-14ad-4620-ab58-4c8689cf6257 req-e3ff5f1d-3790-426c-81cf-22245ba6d56a service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Received event network-vif-unplugged-dc9a3797-4ebe-4970-bae9-fb4fa212c605 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:40:38 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Instance destroyed successfully.
Nov 10 21:40:38 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lazy-loading 'resources' on Instance uuid fbec82a1-7e08-4ccb-a2a8-ff250d507110 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:40:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2137162264',display_name='tempest-AttachVolumeNegativeTest-server-2137162264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2137162264',id=43,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS6r4o8dBNuS1eDrLvzWiknL42mShQrOTbDCzHlkuNnGJoxlNE5jYZA+xe4cJwQ7IHonYHOz33A+sZARyBXtvPHnM0OilPNRL8AfqgVqNNC6cPUL5rWm5dFdCrDjBLI+A==',key_name='tempest-keypair-2053353845',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:37:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96f56b3b4b3e465f97cf07aa338a57a9',ramdisk_id='',reservation_id='r-77qj0dt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-377835946',owner_user_name='tempest-AttachVolumeNegativeTest-377835946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:37:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7762d2ba25d4427ae7ed839e2bbbde4',uuid=fbec82a1-7e08-4ccb-a2a8-ff250d507110,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "address": "fa:16:3e:6b:92:7c", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc9a3797-4e", "ovs_interfaceid": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:40:38 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converting VIF {"id": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "address": "fa:16:3e:6b:92:7c", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc9a3797-4e", "ovs_interfaceid": "dc9a3797-4ebe-4970-bae9-fb4fa212c605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:40:38 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:92:7c,bridge_name='br-int',has_traffic_filtering=True,id=dc9a3797-4ebe-4970-bae9-fb4fa212c605,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc9a3797-4e') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:40:38 user nova-compute[75285]: DEBUG os_vif [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:92:7c,bridge_name='br-int',has_traffic_filtering=True,id=dc9a3797-4ebe-4970-bae9-fb4fa212c605,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc9a3797-4e') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:40:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc9a3797-4e, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:40:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:40:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af606972-7952-4668-a628-95ea29fad6cb) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:40:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:40:38 user nova-compute[75285]: INFO os_vif [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:92:7c,bridge_name='br-int',has_traffic_filtering=True,id=dc9a3797-4ebe-4970-bae9-fb4fa212c605,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc9a3797-4e')
Nov 10 21:40:38 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Deleting instance files /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110_del
Nov 10 21:40:38 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Deletion of /opt/stack/data/nova/instances/fbec82a1-7e08-4ccb-a2a8-ff250d507110_del complete
Nov 10 21:40:38 user nova-compute[75285]: INFO nova.compute.manager [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 10 21:40:38 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:40:38 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:40:38 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:40:39 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:40:39 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Took 0.92 seconds to deallocate network for instance.
Nov 10 21:40:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-f93e614a-920a-439c-af2d-31a0ba9a0d65 req-0fd6a4a5-2c75-4ec4-885b-9fdb830ed047 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Received event network-vif-deleted-dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:40:39 user nova-compute[75285]: INFO nova.compute.manager [req-f93e614a-920a-439c-af2d-31a0ba9a0d65 req-0fd6a4a5-2c75-4ec4-885b-9fdb830ed047 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Neutron deleted interface dc9a3797-4ebe-4970-bae9-fb4fa212c605; detaching it from the instance and deleting it from the info cache
Nov 10 21:40:39 user nova-compute[75285]: DEBUG nova.network.neutron [req-f93e614a-920a-439c-af2d-31a0ba9a0d65 req-0fd6a4a5-2c75-4ec4-885b-9fdb830ed047 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:40:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-f93e614a-920a-439c-af2d-31a0ba9a0d65 req-0fd6a4a5-2c75-4ec4-885b-9fdb830ed047 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Detach interface failed, port_id=dc9a3797-4ebe-4970-bae9-fb4fa212c605, reason: Instance fbec82a1-7e08-4ccb-a2a8-ff250d507110 could not be found. {{(pid=75285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 21:40:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:39 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:40:39 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:40:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-9ee90889-a1e2-48f0-ba04-1ba1fc86501c req-e7bafa63-4eb9-4872-92d7-6a4a5f896e63 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Received event network-vif-plugged-dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:40:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9ee90889-a1e2-48f0-ba04-1ba1fc86501c req-e7bafa63-4eb9-4872-92d7-6a4a5f896e63 service nova] Acquiring lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9ee90889-a1e2-48f0-ba04-1ba1fc86501c req-e7bafa63-4eb9-4872-92d7-6a4a5f896e63 service nova] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-9ee90889-a1e2-48f0-ba04-1ba1fc86501c req-e7bafa63-4eb9-4872-92d7-6a4a5f896e63 service nova] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:40 user nova-compute[75285]: DEBUG nova.compute.manager [req-9ee90889-a1e2-48f0-ba04-1ba1fc86501c req-e7bafa63-4eb9-4872-92d7-6a4a5f896e63 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] No waiting events found dispatching network-vif-plugged-dc9a3797-4ebe-4970-bae9-fb4fa212c605 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:40:40 user nova-compute[75285]: WARNING nova.compute.manager [req-9ee90889-a1e2-48f0-ba04-1ba1fc86501c req-e7bafa63-4eb9-4872-92d7-6a4a5f896e63 service nova] [instance: fbec82a1-7e08-4ccb-a2a8-ff250d507110] Received unexpected event network-vif-plugged-dc9a3797-4ebe-4970-bae9-fb4fa212c605 for instance with vm_state deleted and task_state None.
Nov 10 21:40:40 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Deleted allocations for instance fbec82a1-7e08-4ccb-a2a8-ff250d507110
Nov 10 21:40:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8bc45b0b-78b8-4b24-974e-932437ce53c9 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "fbec82a1-7e08-4ccb-a2a8-ff250d507110" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.507s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.compute.manager [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:40:51 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Creating image(s)
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Did not create local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Ensure instance console log exists: /opt/stack/data/nova/instances/082c9f75-1292-40d8-b6f4-c6737ee69b0f/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Start _get_guest_xml network_info=[{"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '03083eb9-3ed3-471f-ad60-95aacacab30b', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaRJOnBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '082c9f75-1292-40d8-b6f4-c6737ee69b0f', 'attached_at': '', 'detached_at': '', 'volume_id': '8a7c5a89-9fff-423a-b0f0-ce6c402ce01c', 'serial': '8a7c5a89-9fff-423a-b0f0-ce6c402ce01c'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:40:51 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:40:51 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaRJOnBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:40:51 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:40:51 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:40:51 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cb4bfa-5646-4243-af7a-d304015833b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:40:51 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7d1e6a-d37d-4f78-8f38-c6ce743db4f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c] added
Nov 10 21:40:51 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9636b818-7e33-4c98-a34d-69974ccea9f9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a3252b-ec2e-45a9-a213-ce13783b2e6e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaRJOnBA {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaRJOnBA" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2363f8-ba87-43f4-a01c-8f80cad2add9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NaRJOnBA'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1daee7-4b89-410b-8742-fc3ddff903c4]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0a350d-4fa0-4c8e-b434-f7f87b8db75c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:40:51 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:40:51 user nova-compute[75285]:  {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:40:51 user nova-compute[75285]: WARNING os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 21:40:51 user nova-compute[75285]: 
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6286ad-ae9f-49d4-9509-eeb97a183cab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260]
Nov 10 21:40:51 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260] successful.
Nov 10 21:40:51 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c8486b-67d7-42a3-96cc-6c9ed546a17a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c16b18e-2fc7-4bae-9406-3ee641d3c1cd]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:40:51 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:40:51 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aa02b6-e5d7-4f37-8119-30d21374ee20]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:40:51 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaRJOnBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:40:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:52 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:40:52 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23939363962333133', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:40:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939363962333133', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:40:52 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-929483610',display_name='tempest-TestShelveInstance-server-929483610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-929483610',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSoQCpYiHZSWq/7GN6lb2pD1fVkKInwCnijnYQCiTa6k5mU+9olVg72UFswbMyOeQ8xzObBsT8A2Bm+d+qtf3g9MqlbvDPbCPUeqQDLjq3fXPF/XKU7t33F1gzDariB7Q==',key_name='tempest-TestShelveInstance-849712084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4dfd5b630c34fd7a61e8db5a71a60f6',ramdisk_id='',reservation_id='r-0f4w65xj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-141783322',owner_user_name='tempest-TestShelveInstance-141783322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:40:27Z,user_data=None,user_id='d4e52746b7f24c08a3e1dae6e115b577',uuid=082c9f75-1292-40d8-b6f4-c6737ee69b0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:40:52 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Converting VIF {"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:40:52 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:d2:5d,bridge_name='br-int',has_traffic_filtering=True,id=417a97b9-597b-430c-a7d4-5f66fe232e14,network=Network(a01018d1-cd87-4d36-8484-9f198d21d38f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417a97b9-59') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:40:52 user nova-compute[75285]: DEBUG nova.objects.instance [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lazy-loading 'pci_devices' on Instance uuid 082c9f75-1292-40d8-b6f4-c6737ee69b0f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:40:53 user nova-compute[75285]:   <uuid>082c9f75-1292-40d8-b6f4-c6737ee69b0f</uuid>
Nov 10 21:40:53 user nova-compute[75285]:   <name>instance-0000002e</name>
Nov 10 21:40:53 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:40:53 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:40:53 user nova-compute[75285]:   <metadata>
Nov 10 21:40:53 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:40:53 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:40:53 user nova-compute[75285]:       <nova:name>tempest-TestShelveInstance-server-929483610</nova:name>
Nov 10 21:40:53 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:40:51</nova:creationTime>
Nov 10 21:40:53 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:40:53 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:40:53 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:40:53 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:40:53 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:40:53 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:40:53 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:40:53 user nova-compute[75285]:       <nova:owner>
Nov 10 21:40:53 user nova-compute[75285]:         <nova:user uuid="d4e52746b7f24c08a3e1dae6e115b577">tempest-TestShelveInstance-141783322-project-member</nova:user>
Nov 10 21:40:53 user nova-compute[75285]:         <nova:project uuid="e4dfd5b630c34fd7a61e8db5a71a60f6">tempest-TestShelveInstance-141783322</nova:project>
Nov 10 21:40:53 user nova-compute[75285]:       </nova:owner>
Nov 10 21:40:53 user nova-compute[75285]:       <nova:ports>
Nov 10 21:40:53 user nova-compute[75285]:         <nova:port uuid="417a97b9-597b-430c-a7d4-5f66fe232e14">
Nov 10 21:40:53 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 21:40:53 user nova-compute[75285]:         </nova:port>
Nov 10 21:40:53 user nova-compute[75285]:       </nova:ports>
Nov 10 21:40:53 user nova-compute[75285]:     </nova:instance>
Nov 10 21:40:53 user nova-compute[75285]:   </metadata>
Nov 10 21:40:53 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:40:53 user nova-compute[75285]:     <system>
Nov 10 21:40:53 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:40:53 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:40:53 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:40:53 user nova-compute[75285]:       <entry name="serial">082c9f75-1292-40d8-b6f4-c6737ee69b0f</entry>
Nov 10 21:40:53 user nova-compute[75285]:       <entry name="uuid">082c9f75-1292-40d8-b6f4-c6737ee69b0f</entry>
Nov 10 21:40:53 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:40:53 user nova-compute[75285]:     </system>
Nov 10 21:40:53 user nova-compute[75285]:   </sysinfo>
Nov 10 21:40:53 user nova-compute[75285]:   <os>
Nov 10 21:40:53 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:40:53 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:40:53 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:40:53 user nova-compute[75285]:   </os>
Nov 10 21:40:53 user nova-compute[75285]:   <features>
Nov 10 21:40:53 user nova-compute[75285]:     <acpi/>
Nov 10 21:40:53 user nova-compute[75285]:     <apic/>
Nov 10 21:40:53 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:40:53 user nova-compute[75285]:   </features>
Nov 10 21:40:53 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:40:53 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:40:53 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:40:53 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:40:53 user nova-compute[75285]:   </clock>
Nov 10 21:40:53 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:40:53 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:40:53 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:40:53 user nova-compute[75285]:   </cpu>
Nov 10 21:40:53 user nova-compute[75285]:   <devices>
Nov 10 21:40:53 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:40:53 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:40:53 user nova-compute[75285]:       <source dev="/dev/sdb"/>
Nov 10 21:40:53 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:40:53 user nova-compute[75285]:       <serial>8a7c5a89-9fff-423a-b0f0-ce6c402ce01c</serial>
Nov 10 21:40:53 user nova-compute[75285]:     </disk>
Nov 10 21:40:53 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:40:53 user nova-compute[75285]:       <mac address="fa:16:3e:98:d2:5d"/>
Nov 10 21:40:53 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:40:53 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:40:53 user nova-compute[75285]:       <target dev="tap417a97b9-59"/>
Nov 10 21:40:53 user nova-compute[75285]:     </interface>
Nov 10 21:40:53 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:40:53 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/082c9f75-1292-40d8-b6f4-c6737ee69b0f/console.log" append="off"/>
Nov 10 21:40:53 user nova-compute[75285]:     </serial>
Nov 10 21:40:53 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:40:53 user nova-compute[75285]:     <video>
Nov 10 21:40:53 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:40:53 user nova-compute[75285]:     </video>
Nov 10 21:40:53 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:40:53 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:40:53 user nova-compute[75285]:     </rng>
Nov 10 21:40:53 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:40:53 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:40:53 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:40:53 user nova-compute[75285]:     </memballoon>
Nov 10 21:40:53 user nova-compute[75285]:   </devices>
Nov 10 21:40:53 user nova-compute[75285]: </domain>
Nov 10 21:40:53 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-929483610',display_name='tempest-TestShelveInstance-server-929483610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-929483610',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSoQCpYiHZSWq/7GN6lb2pD1fVkKInwCnijnYQCiTa6k5mU+9olVg72UFswbMyOeQ8xzObBsT8A2Bm+d+qtf3g9MqlbvDPbCPUeqQDLjq3fXPF/XKU7t33F1gzDariB7Q==',key_name='tempest-TestShelveInstance-849712084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4dfd5b630c34fd7a61e8db5a71a60f6',ramdisk_id='',reservation_id='r-0f4w65xj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-141783322',owner_user_name='tempest-TestShelveInstance-141783322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:40:27Z,user_data=None,user_id='d4e52746b7f24c08a3e1dae6e115b577',uuid=082c9f75-1292-40d8-b6f4-c6737ee69b0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Converting VIF {"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:d2:5d,bridge_name='br-int',has_traffic_filtering=True,id=417a97b9-597b-430c-a7d4-5f66fe232e14,network=Network(a01018d1-cd87-4d36-8484-9f198d21d38f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417a97b9-59') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG os_vif [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:d2:5d,bridge_name='br-int',has_traffic_filtering=True,id=417a97b9-597b-430c-a7d4-5f66fe232e14,network=Network(a01018d1-cd87-4d36-8484-9f198d21d38f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417a97b9-59') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1acd375c-bd7f-531a-9251-4ea58ce4daf1', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap417a97b9-59, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap417a97b9-59, col_values=(('qos', UUID('88dfa8f2-1ddf-47de-81ce-230076029c3c')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap417a97b9-59, col_values=(('external_ids', {'iface-id': '417a97b9-597b-430c-a7d4-5f66fe232e14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:d2:5d', 'vm-uuid': '082c9f75-1292-40d8-b6f4-c6737ee69b0f'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:53 user nova-compute[75285]: INFO os_vif [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:d2:5d,bridge_name='br-int',has_traffic_filtering=True,id=417a97b9-597b-430c-a7d4-5f66fe232e14,network=Network(a01018d1-cd87-4d36-8484-9f198d21d38f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417a97b9-59')
Nov 10 21:40:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:40:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] No VIF found with MAC fa:16:3e:98:d2:5d, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:40:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:54 user nova-compute[75285]: DEBUG nova.compute.manager [req-01222d70-5dd3-4b3f-be0b-78757fae1ecf req-b78b830c-cd78-445f-825c-a5c634fda58c service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:40:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-01222d70-5dd3-4b3f-be0b-78757fae1ecf req-b78b830c-cd78-445f-825c-a5c634fda58c service nova] Acquiring lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-01222d70-5dd3-4b3f-be0b-78757fae1ecf req-b78b830c-cd78-445f-825c-a5c634fda58c service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-01222d70-5dd3-4b3f-be0b-78757fae1ecf req-b78b830c-cd78-445f-825c-a5c634fda58c service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:54 user nova-compute[75285]: DEBUG nova.compute.manager [req-01222d70-5dd3-4b3f-be0b-78757fae1ecf req-b78b830c-cd78-445f-825c-a5c634fda58c service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] No waiting events found dispatching network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:40:54 user nova-compute[75285]: WARNING nova.compute.manager [req-01222d70-5dd3-4b3f-be0b-78757fae1ecf req-b78b830c-cd78-445f-825c-a5c634fda58c service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received unexpected event network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 for instance with vm_state building and task_state spawning.
Nov 10 21:40:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:56 user nova-compute[75285]: DEBUG nova.compute.manager [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:40:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:40:56 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Instance spawned successfully.
Nov 10 21:40:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:40:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:40:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:40:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:40:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:40:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:40:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:40:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-fff2296b-c42b-4941-9db7-983fe8972011 req-e475c162-cec3-48d6-96ed-fa12699df07b service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:40:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fff2296b-c42b-4941-9db7-983fe8972011 req-e475c162-cec3-48d6-96ed-fa12699df07b service nova] Acquiring lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:40:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fff2296b-c42b-4941-9db7-983fe8972011 req-e475c162-cec3-48d6-96ed-fa12699df07b service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:40:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fff2296b-c42b-4941-9db7-983fe8972011 req-e475c162-cec3-48d6-96ed-fa12699df07b service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:56 user nova-compute[75285]: DEBUG nova.compute.manager [req-fff2296b-c42b-4941-9db7-983fe8972011 req-e475c162-cec3-48d6-96ed-fa12699df07b service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] No waiting events found dispatching network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:40:56 user nova-compute[75285]: WARNING nova.compute.manager [req-fff2296b-c42b-4941-9db7-983fe8972011 req-e475c162-cec3-48d6-96ed-fa12699df07b service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received unexpected event network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 for instance with vm_state building and task_state spawning.
Nov 10 21:40:56 user nova-compute[75285]: INFO nova.compute.manager [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 10 21:40:56 user nova-compute[75285]: DEBUG nova.compute.manager [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:40:56 user nova-compute[75285]: INFO nova.compute.manager [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Took 30.55 seconds to build instance.
Nov 10 21:40:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-036e5cea-5675-4103-a9f7-336cdaf6de32 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.797s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:40:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:40:57 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:40:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IugyLqRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:41:00 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:41:00 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:41:00 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f73b95b-d431-4c8b-bd3d-a113678d0497]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:41:00 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ac4427-aea8-42bd-9a01-af1106a3a41a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f] added
Nov 10 21:41:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8ac172-a811-4501-b0f0-4cefb73a6521]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[437e1356-a272-4f59-9079-94709e017519]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IugyLqRb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IugyLqRb" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[48396248-0e6e-4048-9d77-ab39d9fee821]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IugyLqRb'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f829a2-b614-4427-acae-1fe3f5c0e194]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30c82f9-33f7-426d-b17c-adac33a29d8f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:41:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:41:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c13d07b-ff32-48d8-8b58-ff0bb30905a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f, portal: 172.16.0.220,3260]
Nov 10 21:41:00 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f, portal: 172.16.0.220,3260] successful.
Nov 10 21:41:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d658a0-4e75-4b3f-8e67-a098af29714a]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f80abbc-85d2-4d9b-86c4-eedec369b8b8]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:41:00 user nova-compute[75285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f (non-flash)
Nov 10 21:41:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:41:00 user nova-compute[75285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f (non-flash)
Nov 10 21:41:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee04e69-6e4c-4021-bef2-7cc7eb1cb5dd]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:41:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IugyLqRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:41:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:41:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23964653931373962', 'path': '/dev/sdc'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:41:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964653931373962', 'path': '/dev/sdc'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:41:01 user nova-compute[75285]: DEBUG nova.objects.instance [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'flavor' on Instance uuid b1728988-eadf-468e-9554-ab05b2ddcd4c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:41:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:41:01 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:41:01 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:41:01 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:41:01 user nova-compute[75285]:   <serial>76e47d2f-1fa3-41d2-a901-8ae436cd7f5f</serial>
Nov 10 21:41:01 user nova-compute[75285]: </disk>
Nov 10 21:41:01 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:41:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:41:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:41:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] No VIF found with MAC fa:16:3e:e6:36:4b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:41:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a5af6475-8b42-4160-ae23-31aa286669d7 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.488s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:41:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:07 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:41:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:41:08 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:41:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:41:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-b1728988-eadf-468e-9554-ab05b2ddcd4c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:41:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-b1728988-eadf-468e-9554-ab05b2ddcd4c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:41:08 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Updating instance_info_cache with network_info: [{"id": "61769235-563d-492b-9e22-01df85111b5f", "address": "fa:16:3e:e6:36:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61769235-56", "ovs_interfaceid": "61769235-563d-492b-9e22-01df85111b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-b1728988-eadf-468e-9554-ab05b2ddcd4c" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG nova.objects.instance [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'flavor' on Instance uuid b1728988-eadf-468e-9554-ab05b2ddcd4c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:41:09 user nova-compute[75285]: INFO nova.compute.manager [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Attaching volume ca5c18a6-0b59-4c4f-bd62-55435b735429 to /dev/vdc
Nov 10 21:41:09 user nova-compute[75285]: DEBUG os_brick.utils [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea651a63-b8e1-4b8f-a46a-12ab4f807a45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2900de-586c-4e7c-8ef3-c65435ea661e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5299800-99a8-4db1-951e-63c889456bab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09f3fa6-4a75-4a71-9117-a69c20fbe78b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:41:09 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f26722-f6db-48c1-a855-eef8987cc0a7]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG os_brick.utils [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Updating existing volume attachment record: 72b72d91-2f37-4aec-8b3f-d77dd3989105 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:41:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:41:11 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:41:11 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:41:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8536MB free_disk=24.888893127441406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance b1728988-eadf-468e-9554-ab05b2ddcd4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3de2a41a-da2d-4531-a996-b57a637e163b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 082c9f75-1292-40d8-b6f4-c6737ee69b0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:41:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:41:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:12 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:41:12 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:41:12 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:41:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:41:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:41:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:19 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:41:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:41:31 user nova-compute[75285]: INFO nova.compute.claims [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Claim successful on node user
Nov 10 21:41:31 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:41:31 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:41:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG nova.policy [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7762d2ba25d4427ae7ed839e2bbbde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f56b3b4b3e465f97cf07aa338a57a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:41:31 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Creating image(s)
Nov 10 21:41:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "/opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "/opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "/opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:41:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.185s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk 1073741824" returned: 0 in 0.046s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Cannot resize image /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Ensure instance console log exists: /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:41:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Successfully created port: baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Successfully updated port: baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOThWUlS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:41:33 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:41:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:41:33 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:41:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:41:33 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "refresh_cache-28bd82ee-0d5f-479b-a943-74e1a66d43ae" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquired lock "refresh_cache-28bd82ee-0d5f-479b-a943-74e1a66d43ae" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea64f97-ee10-430c-9e03-d5afc8bf2c5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:41:33 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-aad554b6-520d-4e36-91d3-efc0f1464e01 req-d1981d4a-e6eb-4874-afed-694376e44ad0 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Received event network-changed-baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-aad554b6-520d-4e36-91d3-efc0f1464e01 req-d1981d4a-e6eb-4874-afed-694376e44ad0 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Refreshing instance network info cache due to event network-changed-baa199cd-513c-4e4e-afdf-f76bbcb3db00. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-aad554b6-520d-4e36-91d3-efc0f1464e01 req-d1981d4a-e6eb-4874-afed-694376e44ad0 service nova] Acquiring lock "refresh_cache-28bd82ee-0d5f-479b-a943-74e1a66d43ae" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1359668c-2d55-4776-8a31-2a073b23edce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429] added
Nov 10 21:41:33 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ccb398-926d-4429-a2cd-90386d43719d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c221a1-6e0e-4944-adc5-aa7ea1dfa37d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOThWUlS {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOThWUlS" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0853b2db-f079-4cd3-af42-ed5d67f2351b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LOThWUlS'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:33 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba887ad-78b7-4e0f-bbe2-cfbc3da160f9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d383affb-be82-4c37-ac06-8fc424fe35be]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:41:34 user nova-compute[75285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f (non-flash)
Nov 10 21:41:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:41:34 user nova-compute[75285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f (non-flash)
Nov 10 21:41:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2e40c3-770c-40d0-b1f0-ea4120922da5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429, portal: 172.16.0.220,3260]
Nov 10 21:41:34 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429, portal: 172.16.0.220,3260] successful.
Nov 10 21:41:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[55564b80-34b9-48ea-a863-a784f1764bb3]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d38c684-36a5-4f8f-bcaa-59f553de05d1]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:41:34 user nova-compute[75285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f (non-flash)
Nov 10 21:41:34 user nova-compute[75285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 (non-flash)
Nov 10 21:41:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:41:34 user nova-compute[75285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f (non-flash)
Nov 10 21:41:34 user nova-compute[75285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 (non-flash)
Nov 10 21:41:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7be4230-39fa-4b1f-b248-d8e7d00c73e7]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOThWUlS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.network.neutron [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Updating instance_info_cache with network_info: [{"id": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "address": "fa:16:3e:0f:37:18", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa199cd-51", "ovs_interfaceid": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Releasing lock "refresh_cache-28bd82ee-0d5f-479b-a943-74e1a66d43ae" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Instance network_info: |[{"id": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "address": "fa:16:3e:0f:37:18", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa199cd-51", "ovs_interfaceid": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-aad554b6-520d-4e36-91d3-efc0f1464e01 req-d1981d4a-e6eb-4874-afed-694376e44ad0 service nova] Acquired lock "refresh_cache-28bd82ee-0d5f-479b-a943-74e1a66d43ae" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-aad554b6-520d-4e36-91d3-efc0f1464e01 req-d1981d4a-e6eb-4874-afed-694376e44ad0 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Refreshing network info cache for port baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Start _get_guest_xml network_info=[{"id": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "address": "fa:16:3e:0f:37:18", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa199cd-51", "ovs_interfaceid": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:41:34 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:41:34 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1047738762',display_name='tempest-AttachVolumeNegativeTest-server-1047738762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1047738762',id=47,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaguy4lRHK7vEvB2sp44b3CJi5xOk+zka6rwNCiN9PObIr/DK+0IGqusxNOPhfQd6tQfuJC9sSAAOcuVWB0/5RPO4nBOialIlw2nMVEE4p+Ka0/t8CEU+XDXHwKXClq0w==',key_name='tempest-keypair-536378706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96f56b3b4b3e465f97cf07aa338a57a9',ramdisk_id='',reservation_id='r-fbt8zgw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-377835946',owner_user_name='tempest-AttachVolumeNegativeTest-377835946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:41:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7762d2ba25d4427ae7ed839e2bbbde4',uuid=28bd82ee-0d5f-479b-a943-74e1a66d43ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "address": "fa:16:3e:0f:37:18", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa199cd-51", "ovs_interfaceid": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converting VIF {"id": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "address": "fa:16:3e:0f:37:18", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa199cd-51", "ovs_interfaceid": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:37:18,bridge_name='br-int',has_traffic_filtering=True,id=baa199cd-513c-4e4e-afdf-f76bbcb3db00,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa199cd-51') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lazy-loading 'pci_devices' on Instance uuid 28bd82ee-0d5f-479b-a943-74e1a66d43ae {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:41:34 user nova-compute[75285]:   <uuid>28bd82ee-0d5f-479b-a943-74e1a66d43ae</uuid>
Nov 10 21:41:34 user nova-compute[75285]:   <name>instance-0000002f</name>
Nov 10 21:41:34 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:41:34 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:41:34 user nova-compute[75285]:   <metadata>
Nov 10 21:41:34 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:41:34 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:41:34 user nova-compute[75285]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1047738762</nova:name>
Nov 10 21:41:34 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:41:34</nova:creationTime>
Nov 10 21:41:34 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:41:34 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:41:34 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:41:34 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:41:34 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:41:34 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:41:34 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:41:34 user nova-compute[75285]:       <nova:owner>
Nov 10 21:41:34 user nova-compute[75285]:         <nova:user uuid="d7762d2ba25d4427ae7ed839e2bbbde4">tempest-AttachVolumeNegativeTest-377835946-project-member</nova:user>
Nov 10 21:41:34 user nova-compute[75285]:         <nova:project uuid="96f56b3b4b3e465f97cf07aa338a57a9">tempest-AttachVolumeNegativeTest-377835946</nova:project>
Nov 10 21:41:34 user nova-compute[75285]:       </nova:owner>
Nov 10 21:41:34 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:41:34 user nova-compute[75285]:       <nova:ports>
Nov 10 21:41:34 user nova-compute[75285]:         <nova:port uuid="baa199cd-513c-4e4e-afdf-f76bbcb3db00">
Nov 10 21:41:34 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 21:41:34 user nova-compute[75285]:         </nova:port>
Nov 10 21:41:34 user nova-compute[75285]:       </nova:ports>
Nov 10 21:41:34 user nova-compute[75285]:     </nova:instance>
Nov 10 21:41:34 user nova-compute[75285]:   </metadata>
Nov 10 21:41:34 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:41:34 user nova-compute[75285]:     <system>
Nov 10 21:41:34 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:41:34 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:41:34 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:41:34 user nova-compute[75285]:       <entry name="serial">28bd82ee-0d5f-479b-a943-74e1a66d43ae</entry>
Nov 10 21:41:34 user nova-compute[75285]:       <entry name="uuid">28bd82ee-0d5f-479b-a943-74e1a66d43ae</entry>
Nov 10 21:41:34 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:41:34 user nova-compute[75285]:     </system>
Nov 10 21:41:34 user nova-compute[75285]:   </sysinfo>
Nov 10 21:41:34 user nova-compute[75285]:   <os>
Nov 10 21:41:34 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:41:34 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:41:34 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:41:34 user nova-compute[75285]:   </os>
Nov 10 21:41:34 user nova-compute[75285]:   <features>
Nov 10 21:41:34 user nova-compute[75285]:     <acpi/>
Nov 10 21:41:34 user nova-compute[75285]:     <apic/>
Nov 10 21:41:34 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:41:34 user nova-compute[75285]:   </features>
Nov 10 21:41:34 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:41:34 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:41:34 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:41:34 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:41:34 user nova-compute[75285]:   </clock>
Nov 10 21:41:34 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:41:34 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:41:34 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:41:34 user nova-compute[75285]:   </cpu>
Nov 10 21:41:34 user nova-compute[75285]:   <devices>
Nov 10 21:41:34 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:41:34 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:41:34 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk"/>
Nov 10 21:41:34 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:41:34 user nova-compute[75285]:     </disk>
Nov 10 21:41:34 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:41:34 user nova-compute[75285]:       <mac address="fa:16:3e:0f:37:18"/>
Nov 10 21:41:34 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:41:34 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:41:34 user nova-compute[75285]:       <target dev="tapbaa199cd-51"/>
Nov 10 21:41:34 user nova-compute[75285]:     </interface>
Nov 10 21:41:34 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:41:34 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/console.log" append="off"/>
Nov 10 21:41:34 user nova-compute[75285]:     </serial>
Nov 10 21:41:34 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:41:34 user nova-compute[75285]:     <video>
Nov 10 21:41:34 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:41:34 user nova-compute[75285]:     </video>
Nov 10 21:41:34 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:41:34 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:41:34 user nova-compute[75285]:     </rng>
Nov 10 21:41:34 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:41:34 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:41:34 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:41:34 user nova-compute[75285]:     </memballoon>
Nov 10 21:41:34 user nova-compute[75285]:   </devices>
Nov 10 21:41:34 user nova-compute[75285]: </domain>
Nov 10 21:41:34 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1047738762',display_name='tempest-AttachVolumeNegativeTest-server-1047738762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1047738762',id=47,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaguy4lRHK7vEvB2sp44b3CJi5xOk+zka6rwNCiN9PObIr/DK+0IGqusxNOPhfQd6tQfuJC9sSAAOcuVWB0/5RPO4nBOialIlw2nMVEE4p+Ka0/t8CEU+XDXHwKXClq0w==',key_name='tempest-keypair-536378706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96f56b3b4b3e465f97cf07aa338a57a9',ramdisk_id='',reservation_id='r-fbt8zgw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-377835946',owner_user_name='tempest-AttachVolumeNegativeTest-377835946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:41:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7762d2ba25d4427ae7ed839e2bbbde4',uuid=28bd82ee-0d5f-479b-a943-74e1a66d43ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "address": "fa:16:3e:0f:37:18", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa199cd-51", "ovs_interfaceid": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converting VIF {"id": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "address": "fa:16:3e:0f:37:18", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa199cd-51", "ovs_interfaceid": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:37:18,bridge_name='br-int',has_traffic_filtering=True,id=baa199cd-513c-4e4e-afdf-f76bbcb3db00,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa199cd-51') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG os_vif [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:37:18,bridge_name='br-int',has_traffic_filtering=True,id=baa199cd-513c-4e4e-afdf-f76bbcb3db00,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa199cd-51') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9301e378-4480-5645-bdce-bcef64af256b', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbaa199cd-51, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbaa199cd-51, col_values=(('qos', UUID('df41f8d3-ef68-4364-bb10-25ebff433a16')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbaa199cd-51, col_values=(('external_ids', {'iface-id': 'baa199cd-513c-4e4e-afdf-f76bbcb3db00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:37:18', 'vm-uuid': '28bd82ee-0d5f-479b-a943-74e1a66d43ae'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:34 user nova-compute[75285]: INFO os_vif [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:37:18,bridge_name='br-int',has_traffic_filtering=True,id=baa199cd-513c-4e4e-afdf-f76bbcb3db00,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa199cd-51')
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] No VIF found with MAC fa:16:3e:0f:37:18, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-aad554b6-520d-4e36-91d3-efc0f1464e01 req-d1981d4a-e6eb-4874-afed-694376e44ad0 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Updated VIF entry in instance network info cache for port baa199cd-513c-4e4e-afdf-f76bbcb3db00. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-aad554b6-520d-4e36-91d3-efc0f1464e01 req-d1981d4a-e6eb-4874-afed-694376e44ad0 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Updating instance_info_cache with network_info: [{"id": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "address": "fa:16:3e:0f:37:18", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa199cd-51", "ovs_interfaceid": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:41:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-aad554b6-520d-4e36-91d3-efc0f1464e01 req-d1981d4a-e6eb-4874-afed-694376e44ad0 service nova] Releasing lock "refresh_cache-28bd82ee-0d5f-479b-a943-74e1a66d43ae" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:41:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:41:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26239303038313831', 'path': '/dev/sdd'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:41:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239303038313831', 'path': '/dev/sdd'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:41:35 user nova-compute[75285]: DEBUG nova.objects.instance [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'flavor' on Instance uuid b1728988-eadf-468e-9554-ab05b2ddcd4c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:41:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:41:35 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:41:35 user nova-compute[75285]:   <source dev="/dev/sdd"/>
Nov 10 21:41:35 user nova-compute[75285]:   <target dev="vdc" bus="virtio"/>
Nov 10 21:41:35 user nova-compute[75285]:   <serial>ca5c18a6-0b59-4c4f-bd62-55435b735429</serial>
Nov 10 21:41:35 user nova-compute[75285]: </disk>
Nov 10 21:41:35 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:41:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:41:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:41:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:41:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] No VIF found with MAC fa:16:3e:e6:36:4b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:41:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-65e26cae-93de-4fc9-8618-21c23df9a614 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.315s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:41:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-f526f530-8bf3-48fd-9afe-fddc5a02c450 req-3aa2888d-c940-4353-a947-e6542578f678 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Received event network-vif-plugged-baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:41:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f526f530-8bf3-48fd-9afe-fddc5a02c450 req-3aa2888d-c940-4353-a947-e6542578f678 service nova] Acquiring lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:41:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f526f530-8bf3-48fd-9afe-fddc5a02c450 req-3aa2888d-c940-4353-a947-e6542578f678 service nova] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:41:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f526f530-8bf3-48fd-9afe-fddc5a02c450 req-3aa2888d-c940-4353-a947-e6542578f678 service nova] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:41:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-f526f530-8bf3-48fd-9afe-fddc5a02c450 req-3aa2888d-c940-4353-a947-e6542578f678 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] No waiting events found dispatching network-vif-plugged-baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:41:36 user nova-compute[75285]: WARNING nova.compute.manager [req-f526f530-8bf3-48fd-9afe-fddc5a02c450 req-3aa2888d-c940-4353-a947-e6542578f678 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Received unexpected event network-vif-plugged-baa199cd-513c-4e4e-afdf-f76bbcb3db00 for instance with vm_state building and task_state spawning.
Nov 10 21:41:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:41:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:41:36 user nova-compute[75285]: INFO nova.compute.manager [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Detaching volume 76e47d2f-1fa3-41d2-a901-8ae436cd7f5f
Nov 10 21:41:36 user nova-compute[75285]: INFO nova.virt.block_device [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Attempting to driver detach volume 76e47d2f-1fa3-41d2-a901-8ae436cd7f5f from mountpoint /dev/vdb
Nov 10 21:41:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Attempting to detach device vdb from instance b1728988-eadf-468e-9554-ab05b2ddcd4c from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:41:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:41:36 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:41:36 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:41:36 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:41:36 user nova-compute[75285]:   <serial>76e47d2f-1fa3-41d2-a901-8ae436cd7f5f</serial>
Nov 10 21:41:36 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:41:36 user nova-compute[75285]: </disk>
Nov 10 21:41:36 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:41:36 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Successfully detached device vdb from instance b1728988-eadf-468e-9554-ab05b2ddcd4c from the persistent domain config.
Nov 10 21:41:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1728988-eadf-468e-9554-ab05b2ddcd4c from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:41:36 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:41:36 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:41:36 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:41:36 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:41:36 user nova-compute[75285]:   <serial>76e47d2f-1fa3-41d2-a901-8ae436cd7f5f</serial>
Nov 10 21:41:36 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:41:36 user nova-compute[75285]: </disk>
Nov 10 21:41:36 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:41:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:37 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1728988-eadf-468e-9554-ab05b2ddcd4c {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:41:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:41:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:41:38 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Instance spawned successfully.
Nov 10 21:41:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:41:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:41:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:41:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:41:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:41:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:41:38 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:41:38 user nova-compute[75285]: INFO nova.compute.manager [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 10 21:41:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:41:38 user nova-compute[75285]: INFO nova.compute.manager [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Took 6.97 seconds to build instance.
Nov 10 21:41:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c45e64e4-943c-4322-9f4c-649c8bc0f435 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.076s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:41:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-c773df24-9e19-4865-bcee-88ebc228e2fe req-71ee1d62-757a-4460-9cdc-0431a4e33c53 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Received event network-vif-plugged-baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:41:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c773df24-9e19-4865-bcee-88ebc228e2fe req-71ee1d62-757a-4460-9cdc-0431a4e33c53 service nova] Acquiring lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:41:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c773df24-9e19-4865-bcee-88ebc228e2fe req-71ee1d62-757a-4460-9cdc-0431a4e33c53 service nova] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:41:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c773df24-9e19-4865-bcee-88ebc228e2fe req-71ee1d62-757a-4460-9cdc-0431a4e33c53 service nova] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:41:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-c773df24-9e19-4865-bcee-88ebc228e2fe req-71ee1d62-757a-4460-9cdc-0431a4e33c53 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] No waiting events found dispatching network-vif-plugged-baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:41:38 user nova-compute[75285]: WARNING nova.compute.manager [req-c773df24-9e19-4865-bcee-88ebc228e2fe req-71ee1d62-757a-4460-9cdc-0431a4e33c53 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Received unexpected event network-vif-plugged-baa199cd-513c-4e4e-afdf-f76bbcb3db00 for instance with vm_state active and task_state None.
Nov 10 21:41:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:41:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:41:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:41:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:41:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:57 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b1728988-eadf-468e-9554-ab05b2ddcd4c is timed out.
Nov 10 21:41:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:57 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Successfully detached device vdb from instance b1728988-eadf-468e-9554-ab05b2ddcd4c from the live domain config.
Nov 10 21:41:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IugyLqRb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:41:57 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f5c857-7ce4-466d-8236-1cca6fc0299f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:41:57 user nova-compute[75285]: No targets found.
Nov 10 21:41:57 user nova-compute[75285]: iSNS:
Nov 10 21:41:57 user nova-compute[75285]: No targets found.
Nov 10 21:41:57 user nova-compute[75285]: STATIC:
Nov 10 21:41:57 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c
Nov 10 21:41:57 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:41:57 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:41:57 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429
Nov 10 21:41:57 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:41:57 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:41:57 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f
Nov 10 21:41:57 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:41:57 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:41:57 user nova-compute[75285]: FIRMWARE:
Nov 10 21:41:57 user nova-compute[75285]: No targets found.
Nov 10 21:41:57 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:41:57 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:41:57 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d38714-ec96-40cd-8f59-273b854ac4ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07d1009-34da-4832-b21b-5a6c2ae5adaf]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:41:57 user nova-compute[75285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f (non-flash)
Nov 10 21:41:57 user nova-compute[75285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 (non-flash)
Nov 10 21:41:57 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:41:57 user nova-compute[75285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f (non-flash)
Nov 10 21:41:57 user nova-compute[75285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 (non-flash)
Nov 10 21:41:57 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e4570820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f'): ({'sdc'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Removing single pathed devices sdc {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d2a1af-d48e-4282-bfb0-475eca028bb4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a599d433-5081-4024-9508-8881dde73e81]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Flushing IO for device /dev/sdc {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3764223-1f48-4adf-a287-251636532302]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a064f1cf-797c-4476-9273-ae119fbc1411]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9de404-5918-4394-8abc-253abbbab007]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a867db-2833-4e36-9fd6-65d452122f66]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f, portal: 172.16.0.220,3260]
Nov 10 21:41:57 user nova-compute[75285]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f, portal: 172.16.0.220,3260] successful.
Nov 10 21:41:57 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e47d2f-1fa3-41d2-a901-8ae436cd7f5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee31b43c-62ac-4719-83ed-eea01d3a20e2]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] <== disconnect_volume: return (292ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:41:57 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:41:58 user nova-compute[75285]: DEBUG nova.objects.instance [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'flavor' on Instance uuid b1728988-eadf-468e-9554-ab05b2ddcd4c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:41:58 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:41:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-b2287a9c-18ad-4413-8be7-dfc8d0f3849a tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.858s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:41:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:41:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:41:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:41:59 user nova-compute[75285]: INFO nova.compute.manager [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Detaching volume ca5c18a6-0b59-4c4f-bd62-55435b735429
Nov 10 21:41:59 user nova-compute[75285]: INFO nova.virt.block_device [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Attempting to driver detach volume ca5c18a6-0b59-4c4f-bd62-55435b735429 from mountpoint /dev/vdc
Nov 10 21:41:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Attempting to detach device vdc from instance b1728988-eadf-468e-9554-ab05b2ddcd4c from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:41:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:41:59 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:41:59 user nova-compute[75285]:   <source dev="/dev/sdd"/>
Nov 10 21:41:59 user nova-compute[75285]:   <target dev="vdc" bus="virtio"/>
Nov 10 21:41:59 user nova-compute[75285]:   <serial>ca5c18a6-0b59-4c4f-bd62-55435b735429</serial>
Nov 10 21:41:59 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 21:41:59 user nova-compute[75285]: </disk>
Nov 10 21:41:59 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:41:59 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Successfully detached device vdc from instance b1728988-eadf-468e-9554-ab05b2ddcd4c from the persistent domain config.
Nov 10 21:41:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b1728988-eadf-468e-9554-ab05b2ddcd4c from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:41:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:41:59 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:41:59 user nova-compute[75285]:   <source dev="/dev/sdd"/>
Nov 10 21:41:59 user nova-compute[75285]:   <target dev="vdc" bus="virtio"/>
Nov 10 21:41:59 user nova-compute[75285]:   <serial>ca5c18a6-0b59-4c4f-bd62-55435b735429</serial>
Nov 10 21:41:59 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 21:41:59 user nova-compute[75285]: </disk>
Nov 10 21:41:59 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:41:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b1728988-eadf-468e-9554-ab05b2ddcd4c {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:42:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:07 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:42:08 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:42:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:42:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:42:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:42:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:42:08 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:42:08 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid b50a2144-75e2-4124-9be7-7c5f9a5ce647 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:42:09 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updating instance_info_cache with network_info: [{"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:42:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:42:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:42:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:42:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:42:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:42:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:42:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:42:09 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:42:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:42:11 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:42:11 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:42:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8406MB free_disk=24.858196258544922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance b1728988-eadf-468e-9554-ab05b2ddcd4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3de2a41a-da2d-4531-a996-b57a637e163b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 082c9f75-1292-40d8-b6f4-c6737ee69b0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 28bd82ee-0d5f-479b-a943-74e1a66d43ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:42:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:42:13 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:42:13 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:42:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:42:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:42:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:42:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-766687cc-2eaa-4634-816a-6ca81956bff0 req-14f21526-d567-4d67-a1d5-f55d8506146d service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Received event network-changed-7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-766687cc-2eaa-4634-816a-6ca81956bff0 req-14f21526-d567-4d67-a1d5-f55d8506146d service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Refreshing instance network info cache due to event network-changed-7e91a41b-b901-4e3f-9b04-f81f014d7276. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-766687cc-2eaa-4634-816a-6ca81956bff0 req-14f21526-d567-4d67-a1d5-f55d8506146d service nova] Acquiring lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-766687cc-2eaa-4634-816a-6ca81956bff0 req-14f21526-d567-4d67-a1d5-f55d8506146d service nova] Acquired lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG nova.network.neutron [req-766687cc-2eaa-4634-816a-6ca81956bff0 req-14f21526-d567-4d67-a1d5-f55d8506146d service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Refreshing network info cache for port 7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "3de2a41a-da2d-4531-a996-b57a637e163b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "3de2a41a-da2d-4531-a996-b57a637e163b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG nova.network.neutron [req-766687cc-2eaa-4634-816a-6ca81956bff0 req-14f21526-d567-4d67-a1d5-f55d8506146d service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Updated VIF entry in instance network info cache for port 7e91a41b-b901-4e3f-9b04-f81f014d7276. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG nova.network.neutron [req-766687cc-2eaa-4634-816a-6ca81956bff0 req-14f21526-d567-4d67-a1d5-f55d8506146d service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Updating instance_info_cache with network_info: [{"id": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "address": "fa:16:3e:2b:6c:8d", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e91a41b-b9", "ovs_interfaceid": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG nova.objects.instance [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lazy-loading 'flavor' on Instance uuid 3de2a41a-da2d-4531-a996-b57a637e163b {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-766687cc-2eaa-4634-816a-6ca81956bff0 req-14f21526-d567-4d67-a1d5-f55d8506146d service nova] Releasing lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "3de2a41a-da2d-4531-a996-b57a637e163b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "3de2a41a-da2d-4531-a996-b57a637e163b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "3de2a41a-da2d-4531-a996-b57a637e163b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:42:15 user nova-compute[75285]: INFO nova.compute.manager [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Attaching volume 06d667e8-2ca2-4a85-905d-7cf92c6f6d43 to /dev/vdb
Nov 10 21:42:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG os_brick.utils [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[989a1948-ff03-4979-a097-b376994ddeac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6834e8a3-fcb8-4121-bf8e-35b66fb6c609]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[87535e1b-2542-4d93-aa41-1fe1f6fed588]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[938dbea9-81d5-4233-aa0a-99834d60969d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:42:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:42:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:42:16 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:42:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c5e9f4-9589-49fc-8816-acf9d8e7b38d]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:42:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:42:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:42:16 user nova-compute[75285]: DEBUG os_brick.utils [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:42:16 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Updating existing volume attachment record: 08d2c113-4cee-42c2-b102-148a3bcd3c69 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:42:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-ce2eec0a-e375-4ed1-a1af-f37d5667f967 req-88f54146-89b9-4739-9176-837f7376d61d service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-changed-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:42:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-ce2eec0a-e375-4ed1-a1af-f37d5667f967 req-88f54146-89b9-4739-9176-837f7376d61d service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Refreshing instance network info cache due to event network-changed-417a97b9-597b-430c-a7d4-5f66fe232e14. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:42:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ce2eec0a-e375-4ed1-a1af-f37d5667f967 req-88f54146-89b9-4739-9176-837f7376d61d service nova] Acquiring lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:42:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ce2eec0a-e375-4ed1-a1af-f37d5667f967 req-88f54146-89b9-4739-9176-837f7376d61d service nova] Acquired lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:42:16 user nova-compute[75285]: DEBUG nova.network.neutron [req-ce2eec0a-e375-4ed1-a1af-f37d5667f967 req-88f54146-89b9-4739-9176-837f7376d61d service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Refreshing network info cache for port 417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:42:17 user nova-compute[75285]: DEBUG nova.network.neutron [req-ce2eec0a-e375-4ed1-a1af-f37d5667f967 req-88f54146-89b9-4739-9176-837f7376d61d service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updated VIF entry in instance network info cache for port 417a97b9-597b-430c-a7d4-5f66fe232e14. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:42:17 user nova-compute[75285]: DEBUG nova.network.neutron [req-ce2eec0a-e375-4ed1-a1af-f37d5667f967 req-88f54146-89b9-4739-9176-837f7376d61d service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updating instance_info_cache with network_info: [{"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:42:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ce2eec0a-e375-4ed1-a1af-f37d5667f967 req-88f54146-89b9-4739-9176-837f7376d61d service nova] Releasing lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:42:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:42:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:42:17 user nova-compute[75285]: INFO nova.compute.manager [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Shelve offloading
Nov 10 21:42:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:18 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Instance destroyed successfully.
Nov 10 21:42:18 user nova-compute[75285]: DEBUG nova.compute.manager [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquired lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG nova.network.neutron [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG nova.network.neutron [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updating instance_info_cache with network_info: [{"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Releasing lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG nova.compute.manager [req-66ed7fdb-c015-455c-a518-9b659c241889 req-c36b6814-0917-48a4-bb2f-afb8350cc4fa service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-vif-unplugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66ed7fdb-c015-455c-a518-9b659c241889 req-c36b6814-0917-48a4-bb2f-afb8350cc4fa service nova] Acquiring lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66ed7fdb-c015-455c-a518-9b659c241889 req-c36b6814-0917-48a4-bb2f-afb8350cc4fa service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66ed7fdb-c015-455c-a518-9b659c241889 req-c36b6814-0917-48a4-bb2f-afb8350cc4fa service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG nova.compute.manager [req-66ed7fdb-c015-455c-a518-9b659c241889 req-c36b6814-0917-48a4-bb2f-afb8350cc4fa service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] No waiting events found dispatching network-vif-unplugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:42:18 user nova-compute[75285]: WARNING nova.compute.manager [req-66ed7fdb-c015-455c-a518-9b659c241889 req-c36b6814-0917-48a4-bb2f-afb8350cc4fa service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received unexpected event network-vif-unplugged-417a97b9-597b-430c-a7d4-5f66fe232e14 for instance with vm_state active and task_state shelving.
Nov 10 21:42:18 user nova-compute[75285]: DEBUG nova.compute.manager [req-66ed7fdb-c015-455c-a518-9b659c241889 req-c36b6814-0917-48a4-bb2f-afb8350cc4fa service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66ed7fdb-c015-455c-a518-9b659c241889 req-c36b6814-0917-48a4-bb2f-afb8350cc4fa service nova] Acquiring lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66ed7fdb-c015-455c-a518-9b659c241889 req-c36b6814-0917-48a4-bb2f-afb8350cc4fa service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-66ed7fdb-c015-455c-a518-9b659c241889 req-c36b6814-0917-48a4-bb2f-afb8350cc4fa service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:42:18 user nova-compute[75285]: DEBUG nova.compute.manager [req-66ed7fdb-c015-455c-a518-9b659c241889 req-c36b6814-0917-48a4-bb2f-afb8350cc4fa service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] No waiting events found dispatching network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:42:18 user nova-compute[75285]: WARNING nova.compute.manager [req-66ed7fdb-c015-455c-a518-9b659c241889 req-c36b6814-0917-48a4-bb2f-afb8350cc4fa service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received unexpected event network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 for instance with vm_state active and task_state shelving.
Nov 10 21:42:19 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Instance destroyed successfully.
Nov 10 21:42:19 user nova-compute[75285]: DEBUG nova.objects.instance [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lazy-loading 'resources' on Instance uuid 082c9f75-1292-40d8-b6f4-c6737ee69b0f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-929483610',display_name='tempest-TestShelveInstance-server-929483610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-929483610',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSoQCpYiHZSWq/7GN6lb2pD1fVkKInwCnijnYQCiTa6k5mU+9olVg72UFswbMyOeQ8xzObBsT8A2Bm+d+qtf3g9MqlbvDPbCPUeqQDLjq3fXPF/XKU7t33F1gzDariB7Q==',key_name='tempest-TestShelveInstance-849712084',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:40:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4dfd5b630c34fd7a61e8db5a71a60f6',ramdisk_id='',reservation_id='r-0f4w65xj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-141783322',owner_user_name='tempest-TestShelveInstance-141783322-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:40:57Z,user_data=None,user_id='d4e52746b7f24c08a3e1dae6e115b577',uuid=082c9f75-1292-40d8-b6f4-c6737ee69b0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Converting VIF {"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:d2:5d,bridge_name='br-int',has_traffic_filtering=True,id=417a97b9-597b-430c-a7d4-5f66fe232e14,network=Network(a01018d1-cd87-4d36-8484-9f198d21d38f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417a97b9-59') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_vif [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:d2:5d,bridge_name='br-int',has_traffic_filtering=True,id=417a97b9-597b-430c-a7d4-5f66fe232e14,network=Network(a01018d1-cd87-4d36-8484-9f198d21d38f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417a97b9-59') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap417a97b9-59, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-3a3103a7-f470-4d8e-baa7-782e5c612c3d req-66c9361b-0870-4157-92e8-e1aa4982cbf7 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-changed-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-3a3103a7-f470-4d8e-baa7-782e5c612c3d req-66c9361b-0870-4157-92e8-e1aa4982cbf7 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Refreshing instance network info cache due to event network-changed-417a97b9-597b-430c-a7d4-5f66fe232e14. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3a3103a7-f470-4d8e-baa7-782e5c612c3d req-66c9361b-0870-4157-92e8-e1aa4982cbf7 service nova] Acquiring lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3a3103a7-f470-4d8e-baa7-782e5c612c3d req-66c9361b-0870-4157-92e8-e1aa4982cbf7 service nova] Acquired lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG nova.network.neutron [req-3a3103a7-f470-4d8e-baa7-782e5c612c3d req-66c9361b-0870-4157-92e8-e1aa4982cbf7 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Refreshing network info cache for port 417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88dfa8f2-1ddf-47de-81ce-230076029c3c) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:19 user nova-compute[75285]: INFO os_vif [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:d2:5d,bridge_name='br-int',has_traffic_filtering=True,id=417a97b9-597b-430c-a7d4-5f66fe232e14,network=Network(a01018d1-cd87-4d36-8484-9f198d21d38f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417a97b9-59')
Nov 10 21:42:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaRJOnBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:42:19 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afe2f11-21de-4bd6-a236-4b7057aff0d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:42:19 user nova-compute[75285]: No targets found.
Nov 10 21:42:19 user nova-compute[75285]: iSNS:
Nov 10 21:42:19 user nova-compute[75285]: No targets found.
Nov 10 21:42:19 user nova-compute[75285]: STATIC:
Nov 10 21:42:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c
Nov 10 21:42:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:42:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:42:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429
Nov 10 21:42:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:42:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:42:19 user nova-compute[75285]: FIRMWARE:
Nov 10 21:42:19 user nova-compute[75285]: No targets found.
Nov 10 21:42:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:42:19 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:42:19 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ff43b5-fb6a-43d7-a9b4-198a534baa46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1512b11-874d-48c3-91d0-49e64cf59009]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:42:19 user nova-compute[75285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 (non-flash)
Nov 10 21:42:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:42:19 user nova-compute[75285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 (non-flash)
Nov 10 21:42:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a0413ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcf37fd-333a-47d2-8875-88486e4aeefc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8faccec-f943-4abb-8c69-0bafaef55f5c]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7568ad7b-585c-415e-b75f-af2ea5d4ec40]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1043c5c1-8415-4f91-9362-95c23b4485a2]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06c0921-19ab-4594-b533-0d76d41339fe]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc35eaec-f0cc-41b1-9453-1592fa77b41b]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260]
Nov 10 21:42:19 user nova-compute[75285]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260] successful.
Nov 10 21:42:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c349cf9-3c59-44e4-986c-94bd02ea3734]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] <== disconnect_volume: return (326ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:42:19 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Deleting instance files /opt/stack/data/nova/instances/082c9f75-1292-40d8-b6f4-c6737ee69b0f_del
Nov 10 21:42:19 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Deletion of /opt/stack/data/nova/instances/082c9f75-1292-40d8-b6f4-c6737ee69b0f_del complete
Nov 10 21:42:19 user nova-compute[75285]: DEBUG nova.network.neutron [req-3a3103a7-f470-4d8e-baa7-782e5c612c3d req-66c9361b-0870-4157-92e8-e1aa4982cbf7 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updated VIF entry in instance network info cache for port 417a97b9-597b-430c-a7d4-5f66fe232e14. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG nova.network.neutron [req-3a3103a7-f470-4d8e-baa7-782e5c612c3d req-66c9361b-0870-4157-92e8-e1aa4982cbf7 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updating instance_info_cache with network_info: [{"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": null, "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap417a97b9-59", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-3a3103a7-f470-4d8e-baa7-782e5c612c3d req-66c9361b-0870-4157-92e8-e1aa4982cbf7 service nova] Releasing lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:42:19 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance b1728988-eadf-468e-9554-ab05b2ddcd4c is timed out.
Nov 10 21:42:19 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Successfully detached device vdc from instance b1728988-eadf-468e-9554-ab05b2ddcd4c from the live domain config.
Nov 10 21:42:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOThWUlS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:42:19 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a0644b-72e6-429c-87b8-afbbfbb83ab9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:42:19 user nova-compute[75285]: No targets found.
Nov 10 21:42:19 user nova-compute[75285]: iSNS:
Nov 10 21:42:19 user nova-compute[75285]: No targets found.
Nov 10 21:42:19 user nova-compute[75285]: STATIC:
Nov 10 21:42:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429
Nov 10 21:42:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:42:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:42:19 user nova-compute[75285]: FIRMWARE:
Nov 10 21:42:19 user nova-compute[75285]: No targets found.
Nov 10 21:42:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:42:19 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:42:19 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcc5564-b7e9-439d-8340-aefb67e223f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b007813-c4e3-4975-9f97-accc5169a8db]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 (non-flash)
Nov 10 21:42:20 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 (non-flash)
Nov 10 21:42:20 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e44e5120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429'): ({'sdd'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Removing single pathed devices sdd {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bef5a0-568c-4b23-a74b-1c4810363099]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91e4798-2084-4742-a847-488cfc6fc738]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Flushing IO for device /dev/sdd {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f632f17a-3868-49b2-9776-ccbb6a8ed888]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.080s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83d667b-c1e7-4c6d-97f5-79555e0a9b58]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] SCSI volumes sdd have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d91a21-010c-45e3-a0a9-05939a69e60d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1c46bd-d4e2-4013-95d6-3bfba9dfcffa]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429, portal: 172.16.0.220,3260]
Nov 10 21:42:20 user nova-compute[75285]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429, portal: 172.16.0.220,3260] successful.
Nov 10 21:42:20 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5c18a6-0b59-4c4f-bd62-55435b735429 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e07c3a-0b92-4a50-87c6-e28e85f8c6be]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] <== disconnect_volume: return (324ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:42:20 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Deleted allocations for instance 082c9f75-1292-40d8-b6f4-c6737ee69b0f
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:42:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:42:21 user nova-compute[75285]: DEBUG nova.objects.instance [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lazy-loading 'numa_topology' on Instance uuid 082c9f75-1292-40d8-b6f4-c6737ee69b0f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:42:21 user nova-compute[75285]: DEBUG nova.objects.base [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Object Instance<082c9f75-1292-40d8-b6f4-c6737ee69b0f> lazy-loaded attributes: resources,numa_topology {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:42:21 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:42:21 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:42:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:42:21 user nova-compute[75285]: DEBUG nova.objects.instance [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'flavor' on Instance uuid b1728988-eadf-468e-9554-ab05b2ddcd4c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:42:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-dd872afc-497c-4a1a-98c2-4833c35cbf5b tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.915s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:42:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5e1fc24e-ffec-4b72-89ac-882bf84047b2 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.904s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:42:22 user nova-compute[75285]: INFO nova.compute.manager [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Terminating instance
Nov 10 21:42:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-58b4da00-02e9-4d3b-aaf8-ab97a20ba95d req-8288ba25-6a1b-4207-aead-629f2e4c5e38 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Received event network-vif-unplugged-61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-58b4da00-02e9-4d3b-aaf8-ab97a20ba95d req-8288ba25-6a1b-4207-aead-629f2e4c5e38 service nova] Acquiring lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-58b4da00-02e9-4d3b-aaf8-ab97a20ba95d req-8288ba25-6a1b-4207-aead-629f2e4c5e38 service nova] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-58b4da00-02e9-4d3b-aaf8-ab97a20ba95d req-8288ba25-6a1b-4207-aead-629f2e4c5e38 service nova] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-58b4da00-02e9-4d3b-aaf8-ab97a20ba95d req-8288ba25-6a1b-4207-aead-629f2e4c5e38 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] No waiting events found dispatching network-vif-unplugged-61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:42:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-58b4da00-02e9-4d3b-aaf8-ab97a20ba95d req-8288ba25-6a1b-4207-aead-629f2e4c5e38 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Received event network-vif-unplugged-61769235-563d-492b-9e22-01df85111b5f for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:23 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Instance destroyed successfully.
Nov 10 21:42:23 user nova-compute[75285]: DEBUG nova.objects.instance [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lazy-loading 'resources' on Instance uuid b1728988-eadf-468e-9554-ab05b2ddcd4c {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:38:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-319214058',display_name='tempest-AttachVolumeTestJSON-server-319214058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-319214058',id=44,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQ2RIxYCQMmIFfEOoE3epQ9wCXGiCXTB+DEbr0u2kJM6suaYv1+fW6uSJokY+ytRQjKd5GJNarDt5WUBYrsHpI0/A+u95pTYDTpR9WjUsEyZw+GOU6Vag3q5UAUJMEI1w==',key_name='tempest-keypair-209731017',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:38:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63bf2d92f6524ec0af61667a9f06bc49',ramdisk_id='',reservation_id='r-07iwqlqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-738528264',owner_user_name='tempest-AttachVolumeTestJSON-738528264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780e11dc70f54bf88772860118930629',uuid=b1728988-eadf-468e-9554-ab05b2ddcd4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61769235-563d-492b-9e22-01df85111b5f", "address": "fa:16:3e:e6:36:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61769235-56", "ovs_interfaceid": "61769235-563d-492b-9e22-01df85111b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converting VIF {"id": "61769235-563d-492b-9e22-01df85111b5f", "address": "fa:16:3e:e6:36:4b", "network": {"id": "7a00f1a6-f64d-4520-bf07-0e0bced93bba", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2099874720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63bf2d92f6524ec0af61667a9f06bc49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61769235-56", "ovs_interfaceid": "61769235-563d-492b-9e22-01df85111b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=61769235-563d-492b-9e22-01df85111b5f,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61769235-56') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG os_vif [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=61769235-563d-492b-9e22-01df85111b5f,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61769235-56') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61769235-56, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21dde10e-00fc-49c7-8035-3919afcdf95b) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:42:23 user nova-compute[75285]: INFO os_vif [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=61769235-563d-492b-9e22-01df85111b5f,network=Network(7a00f1a6-f64d-4520-bf07-0e0bced93bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61769235-56')
Nov 10 21:42:23 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Deleting instance files /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c_del
Nov 10 21:42:23 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Deletion of /opt/stack/data/nova/instances/b1728988-eadf-468e-9554-ab05b2ddcd4c_del complete
Nov 10 21:42:23 user nova-compute[75285]: INFO nova.compute.manager [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 10 21:42:23 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:42:23 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:42:24 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:42:24 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Took 0.82 seconds to deallocate network for instance.
Nov 10 21:42:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:42:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:42:24 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:42:24 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:42:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:42:24 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Deleted allocations for instance b1728988-eadf-468e-9554-ab05b2ddcd4c
Nov 10 21:42:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-5eb39d56-c2b4-47de-ad57-7d2518ec5d69 tempest-AttachVolumeTestJSON-738528264 tempest-AttachVolumeTestJSON-738528264-project-member] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.030s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:42:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-f0f34460-d656-4630-8306-0eb52a81579a req-17c97115-b0a1-4f40-8d06-3f19e60703c0 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Received event network-vif-plugged-61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:42:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f0f34460-d656-4630-8306-0eb52a81579a req-17c97115-b0a1-4f40-8d06-3f19e60703c0 service nova] Acquiring lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:42:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f0f34460-d656-4630-8306-0eb52a81579a req-17c97115-b0a1-4f40-8d06-3f19e60703c0 service nova] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:42:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f0f34460-d656-4630-8306-0eb52a81579a req-17c97115-b0a1-4f40-8d06-3f19e60703c0 service nova] Lock "b1728988-eadf-468e-9554-ab05b2ddcd4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:42:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-f0f34460-d656-4630-8306-0eb52a81579a req-17c97115-b0a1-4f40-8d06-3f19e60703c0 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] No waiting events found dispatching network-vif-plugged-61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:42:24 user nova-compute[75285]: WARNING nova.compute.manager [req-f0f34460-d656-4630-8306-0eb52a81579a req-17c97115-b0a1-4f40-8d06-3f19e60703c0 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Received unexpected event network-vif-plugged-61769235-563d-492b-9e22-01df85111b5f for instance with vm_state deleted and task_state None.
Nov 10 21:42:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-f0f34460-d656-4630-8306-0eb52a81579a req-17c97115-b0a1-4f40-8d06-3f19e60703c0 service nova] [instance: b1728988-eadf-468e-9554-ab05b2ddcd4c] Received event network-vif-deleted-61769235-563d-492b-9e22-01df85111b5f {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:42:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:42:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:42:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:42:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:42:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxUYPeED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:42:39 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:42:39 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:42:39 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b062bdca-072b-41f0-8399-fd34db65a030]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:42:39 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac38e94-97b4-425a-96ce-e78fbe8308a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43] added
Nov 10 21:42:39 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc04cdf6-5724-490e-9430-3ab05a36bcf6]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5afc84-ac91-492f-bbfa-731f9d86ae71]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxUYPeED {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxUYPeED" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4110bf19-312f-47d5-a651-9a3b8f70293e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wxUYPeED'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab5323c-0e06-4f2a-b57e-06550e88a3da]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbfc223-1999-41ff-a12b-6621822409d9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:42:39 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:42:39 user nova-compute[75285]:  {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:42:39 user nova-compute[75285]: WARNING os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 21:42:39 user nova-compute[75285]: 
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f030b8d-6d1c-45f7-8288-410fde2919b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43, portal: 172.16.0.220,3260]
Nov 10 21:42:39 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43, portal: 172.16.0.220,3260] successful.
Nov 10 21:42:39 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a350e87-0e85-472d-9909-8cb69e83b5d6]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c07da0a-91ae-4ed4-8e49-e12bbd3df430]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 (non-flash)
Nov 10 21:42:39 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 (non-flash)
Nov 10 21:42:39 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3732e7a-148e-4b1b-b57f-50405ba52699]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:42:39 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxUYPeED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:42:40 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:42:40 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23435323537623766', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:42:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435323537623766', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:42:40 user nova-compute[75285]: DEBUG nova.objects.instance [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lazy-loading 'flavor' on Instance uuid 3de2a41a-da2d-4531-a996-b57a637e163b {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:42:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:42:40 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:42:40 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:42:40 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:42:40 user nova-compute[75285]:   <serial>06d667e8-2ca2-4a85-905d-7cf92c6f6d43</serial>
Nov 10 21:42:40 user nova-compute[75285]: </disk>
Nov 10 21:42:40 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:42:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:42:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:42:40 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] No VIF found with MAC fa:16:3e:2b:6c:8d, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:42:40 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e0d40576-5180-41e2-a224-cd17b752546e tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "3de2a41a-da2d-4531-a996-b57a637e163b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.069s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:42:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "3de2a41a-da2d-4531-a996-b57a637e163b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:42:42 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "3de2a41a-da2d-4531-a996-b57a637e163b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:42:42 user nova-compute[75285]: INFO nova.compute.manager [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Detaching volume 06d667e8-2ca2-4a85-905d-7cf92c6f6d43
Nov 10 21:42:42 user nova-compute[75285]: INFO nova.virt.block_device [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Attempting to driver detach volume 06d667e8-2ca2-4a85-905d-7cf92c6f6d43 from mountpoint /dev/vdb
Nov 10 21:42:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Attempting to detach device vdb from instance 3de2a41a-da2d-4531-a996-b57a637e163b from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:42:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:42:42 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:42:42 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:42:42 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:42:42 user nova-compute[75285]:   <serial>06d667e8-2ca2-4a85-905d-7cf92c6f6d43</serial>
Nov 10 21:42:42 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:42:42 user nova-compute[75285]: </disk>
Nov 10 21:42:42 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:42:42 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Successfully detached device vdb from instance 3de2a41a-da2d-4531-a996-b57a637e163b from the persistent domain config.
Nov 10 21:42:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3de2a41a-da2d-4531-a996-b57a637e163b from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:42:42 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:42:42 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:42:42 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:42:42 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:42:42 user nova-compute[75285]:   <serial>06d667e8-2ca2-4a85-905d-7cf92c6f6d43</serial>
Nov 10 21:42:42 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:42:42 user nova-compute[75285]: </disk>
Nov 10 21:42:42 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:42:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3de2a41a-da2d-4531-a996-b57a637e163b {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:42:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:42:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:00 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:43:03 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3de2a41a-da2d-4531-a996-b57a637e163b is timed out.
Nov 10 21:43:03 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Successfully detached device vdb from instance 3de2a41a-da2d-4531-a996-b57a637e163b from the live domain config.
Nov 10 21:43:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxUYPeED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:43:03 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a925822-cdee-42f3-8623-da62c48036ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:43:03 user nova-compute[75285]: No targets found.
Nov 10 21:43:03 user nova-compute[75285]: iSNS:
Nov 10 21:43:03 user nova-compute[75285]: No targets found.
Nov 10 21:43:03 user nova-compute[75285]: STATIC:
Nov 10 21:43:03 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43
Nov 10 21:43:03 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:43:03 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:43:03 user nova-compute[75285]: FIRMWARE:
Nov 10 21:43:03 user nova-compute[75285]: No targets found.
Nov 10 21:43:03 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:43:03 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:43:03 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[db60acf2-f491-4ebe-a388-2ac52185d72a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48d4630-53e7-42e9-a0a6-718e6486c071]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 (non-flash)
Nov 10 21:43:03 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 (non-flash)
Nov 10 21:43:03 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49fc33ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[52822768-3dd4-45bb-b44d-0ef8b788453a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fea499-e4ee-41db-8e12-c760b3e168af]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea748b8a-3d9f-425d-96fe-84c5d07319ba]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70607cf-177b-4060-95c6-9f0af7e15c55]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1989399e-96e3-4ecc-b51b-673faa2b0e5d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[64489ae3-e583-4ecd-8018-8ac2f76f273a]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43, portal: 172.16.0.220,3260]
Nov 10 21:43:03 user nova-compute[75285]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43, portal: 172.16.0.220,3260] successful.
Nov 10 21:43:03 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d667e8-2ca2-4a85-905d-7cf92c6f6d43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a64d79-c844-4e56-b225-d4740f90715b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] <== disconnect_volume: return (282ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:43:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:43:04 user nova-compute[75285]: DEBUG nova.objects.instance [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lazy-loading 'flavor' on Instance uuid 3de2a41a-da2d-4531-a996-b57a637e163b {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:43:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-7574540a-aba2-45e7-957c-9d4986838cf6 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "3de2a41a-da2d-4531-a996-b57a637e163b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.765s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:43:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:43:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:43:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:43:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:43:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:43:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:43:09 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:43:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:11 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:43:11 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:43:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8669MB free_disk=24.884323120117188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:43:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:43:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:43:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:43:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 3de2a41a-da2d-4531-a996-b57a637e163b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:43:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 28bd82ee-0d5f-479b-a943-74e1a66d43ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:43:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:43:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:43:11 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:43:11 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:43:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:43:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:43:12 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:43:12 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:43:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:43:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:43:12 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:43:13 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Updating instance_info_cache with network_info: [{"id": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "address": "fa:16:3e:2b:6c:8d", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e91a41b-b9", "ovs_interfaceid": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:43:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:43:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:43:13 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:43:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:43:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:13 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:43:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:43:15 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:43:16 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:43:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:20 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:43:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-72d7ffd2-0bd6-4b87-824f-66c9f86933f7 req-6529a1c5-c354-4247-9667-c760e77199f9 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Received event network-changed-baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:43:22 user nova-compute[75285]: DEBUG nova.compute.manager [req-72d7ffd2-0bd6-4b87-824f-66c9f86933f7 req-6529a1c5-c354-4247-9667-c760e77199f9 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Refreshing instance network info cache due to event network-changed-baa199cd-513c-4e4e-afdf-f76bbcb3db00. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:43:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-72d7ffd2-0bd6-4b87-824f-66c9f86933f7 req-6529a1c5-c354-4247-9667-c760e77199f9 service nova] Acquiring lock "refresh_cache-28bd82ee-0d5f-479b-a943-74e1a66d43ae" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:43:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-72d7ffd2-0bd6-4b87-824f-66c9f86933f7 req-6529a1c5-c354-4247-9667-c760e77199f9 service nova] Acquired lock "refresh_cache-28bd82ee-0d5f-479b-a943-74e1a66d43ae" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:43:22 user nova-compute[75285]: DEBUG nova.network.neutron [req-72d7ffd2-0bd6-4b87-824f-66c9f86933f7 req-6529a1c5-c354-4247-9667-c760e77199f9 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Refreshing network info cache for port baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:43:23 user nova-compute[75285]: DEBUG nova.network.neutron [req-72d7ffd2-0bd6-4b87-824f-66c9f86933f7 req-6529a1c5-c354-4247-9667-c760e77199f9 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Updated VIF entry in instance network info cache for port baa199cd-513c-4e4e-afdf-f76bbcb3db00. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:43:23 user nova-compute[75285]: DEBUG nova.network.neutron [req-72d7ffd2-0bd6-4b87-824f-66c9f86933f7 req-6529a1c5-c354-4247-9667-c760e77199f9 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Updating instance_info_cache with network_info: [{"id": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "address": "fa:16:3e:0f:37:18", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa199cd-51", "ovs_interfaceid": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:43:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-72d7ffd2-0bd6-4b87-824f-66c9f86933f7 req-6529a1c5-c354-4247-9667-c760e77199f9 service nova] Releasing lock "refresh_cache-28bd82ee-0d5f-479b-a943-74e1a66d43ae" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:43:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:43:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:43:29 user nova-compute[75285]: DEBUG nova.objects.instance [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lazy-loading 'flavor' on Instance uuid 28bd82ee-0d5f-479b-a943-74e1a66d43ae {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:43:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:43:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:43:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:43:29 user nova-compute[75285]: INFO nova.compute.manager [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Attaching volume 731e80ce-3033-4a2b-bec4-7c9c2d21352b to /dev/vdb
Nov 10 21:43:29 user nova-compute[75285]: DEBUG os_brick.utils [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:43:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[930d83b7-d18d-43a2-bb99-e1de4d2c7f39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fe48cf-540e-4a4d-89ea-8934f9c95329]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88b1e22-4294-4359-9aa6-dd1dacd0ba14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e198b9a-9687-4a61-bb2c-4297f74a6d02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:43:30 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:43:30 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00d2568-5465-4368-8d70-23639c731ead]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG os_brick.utils [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:43:30 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Updating existing volume attachment record: 8ebd9fe0-e2cf-46b6-b005-a5e1032dda7e {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:43:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "3de2a41a-da2d-4531-a996-b57a637e163b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "3de2a41a-da2d-4531-a996-b57a637e163b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:43:33 user nova-compute[75285]: INFO nova.compute.manager [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Terminating instance
Nov 10 21:43:33 user nova-compute[75285]: DEBUG nova.compute.manager [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-75a7597f-ae1f-43ee-b0bf-138c72b55280 req-ba13f826-6dae-4991-8a62-22864b72ccf0 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Received event network-changed-7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-75a7597f-ae1f-43ee-b0bf-138c72b55280 req-ba13f826-6dae-4991-8a62-22864b72ccf0 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Refreshing instance network info cache due to event network-changed-7e91a41b-b901-4e3f-9b04-f81f014d7276. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-75a7597f-ae1f-43ee-b0bf-138c72b55280 req-ba13f826-6dae-4991-8a62-22864b72ccf0 service nova] Acquiring lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-75a7597f-ae1f-43ee-b0bf-138c72b55280 req-ba13f826-6dae-4991-8a62-22864b72ccf0 service nova] Acquired lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG nova.network.neutron [req-75a7597f-ae1f-43ee-b0bf-138c72b55280 req-ba13f826-6dae-4991-8a62-22864b72ccf0 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Refreshing network info cache for port 7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-59e007cf-691e-4ce2-88bd-c63aeb7d4b63 req-b0308ee2-85a5-437f-b016-8a82fe34d2c4 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Received event network-vif-unplugged-7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-59e007cf-691e-4ce2-88bd-c63aeb7d4b63 req-b0308ee2-85a5-437f-b016-8a82fe34d2c4 service nova] Acquiring lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-59e007cf-691e-4ce2-88bd-c63aeb7d4b63 req-b0308ee2-85a5-437f-b016-8a82fe34d2c4 service nova] Lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-59e007cf-691e-4ce2-88bd-c63aeb7d4b63 req-b0308ee2-85a5-437f-b016-8a82fe34d2c4 service nova] Lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-59e007cf-691e-4ce2-88bd-c63aeb7d4b63 req-b0308ee2-85a5-437f-b016-8a82fe34d2c4 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] No waiting events found dispatching network-vif-unplugged-7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:43:33 user nova-compute[75285]: DEBUG nova.compute.manager [req-59e007cf-691e-4ce2-88bd-c63aeb7d4b63 req-b0308ee2-85a5-437f-b016-8a82fe34d2c4 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Received event network-vif-unplugged-7e91a41b-b901-4e3f-9b04-f81f014d7276 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-75a7597f-ae1f-43ee-b0bf-138c72b55280 req-ba13f826-6dae-4991-8a62-22864b72ccf0 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Updated VIF entry in instance network info cache for port 7e91a41b-b901-4e3f-9b04-f81f014d7276. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-75a7597f-ae1f-43ee-b0bf-138c72b55280 req-ba13f826-6dae-4991-8a62-22864b72ccf0 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Updating instance_info_cache with network_info: [{"id": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "address": "fa:16:3e:2b:6c:8d", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e91a41b-b9", "ovs_interfaceid": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-75a7597f-ae1f-43ee-b0bf-138c72b55280 req-ba13f826-6dae-4991-8a62-22864b72ccf0 service nova] Releasing lock "refresh_cache-3de2a41a-da2d-4531-a996-b57a637e163b" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:43:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Instance destroyed successfully.
Nov 10 21:43:34 user nova-compute[75285]: DEBUG nova.objects.instance [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lazy-loading 'resources' on Instance uuid 3de2a41a-da2d-4531-a996-b57a637e163b {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:40:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-81119561',display_name='tempest-TestStampPattern-server-81119561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-81119561',id=45,image_ref='b45ea9b8-79d0-4bd0-972e-63d6917fe8ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDesKwnov6nE2ld9TlR2fU3g0q2iM+VKiUlmhK8jP1iPmNHB6lDKQy4ay9Gx6aPViDAsMciHIGIxIzSorT0IkxMhTgbfUY9SEgK+3RievcFZ227mhE1qSONbcnrF6fHmFg==',key_name='tempest-TestStampPattern-930691110',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:40:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='362608e7cf3b4c1fb9dc6187091b3dbb',ramdisk_id='',reservation_id='r-nxdd4xgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b50a2144-75e2-4124-9be7-7c5f9a5ce647',image_min_disk='1',image_min_ram='0',image_owner_id='362608e7cf3b4c1fb9dc6187091b3dbb',image_owner_project_name='tempest-TestStampPattern-248662818',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-248662818-project-member',image_user_id='4b47da8e21f44b98aec923a5bf71b361',owner_project_name='tempest-TestStampPattern-248662818',owner_user_name='tempest-TestStampPattern-248662818-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:40:31Z,user_data=None,user_id='4b47da8e21f44b98aec923a5bf71b361',uuid=3de2a41a-da2d-4531-a996-b57a637e163b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "address": "fa:16:3e:2b:6c:8d", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e91a41b-b9", "ovs_interfaceid": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Converting VIF {"id": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "address": "fa:16:3e:2b:6c:8d", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e91a41b-b9", "ovs_interfaceid": "7e91a41b-b901-4e3f-9b04-f81f014d7276", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:6c:8d,bridge_name='br-int',has_traffic_filtering=True,id=7e91a41b-b901-4e3f-9b04-f81f014d7276,network=Network(f2a1706e-9d15-46ca-93a2-9fb70223a9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e91a41b-b9') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG os_vif [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:6c:8d,bridge_name='br-int',has_traffic_filtering=True,id=7e91a41b-b901-4e3f-9b04-f81f014d7276,network=Network(f2a1706e-9d15-46ca-93a2-9fb70223a9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e91a41b-b9') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e91a41b-b9, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e129855-d0a7-42b2-9014-4cdbc2f89b27) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:43:34 user nova-compute[75285]: INFO os_vif [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:6c:8d,bridge_name='br-int',has_traffic_filtering=True,id=7e91a41b-b901-4e3f-9b04-f81f014d7276,network=Network(f2a1706e-9d15-46ca-93a2-9fb70223a9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e91a41b-b9')
Nov 10 21:43:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Deleting instance files /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b_del
Nov 10 21:43:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Deletion of /opt/stack/data/nova/instances/3de2a41a-da2d-4531-a996-b57a637e163b_del complete
Nov 10 21:43:34 user nova-compute[75285]: INFO nova.compute.manager [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 10 21:43:34 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:43:34 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Took 0.50 seconds to deallocate network for instance.
Nov 10 21:43:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-44ba7e8a-54d2-44a2-85f8-d0be858c702a req-fb458456-f022-4d2b-af61-8100d7a52584 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Received event network-vif-deleted-7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:43:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:43:35 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:43:35 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:43:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:43:35 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Deleted allocations for instance 3de2a41a-da2d-4531-a996-b57a637e163b
Nov 10 21:43:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-891f3c52-34ea-4751-971a-425d63a624e7 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "3de2a41a-da2d-4531-a996-b57a637e163b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.744s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:43:35 user nova-compute[75285]: DEBUG nova.compute.manager [req-28270b0e-adec-4158-a074-003b7502cb7f req-4370ab91-cabb-42c7-982c-0e64a6fab578 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Received event network-vif-plugged-7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:43:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-28270b0e-adec-4158-a074-003b7502cb7f req-4370ab91-cabb-42c7-982c-0e64a6fab578 service nova] Acquiring lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:43:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-28270b0e-adec-4158-a074-003b7502cb7f req-4370ab91-cabb-42c7-982c-0e64a6fab578 service nova] Lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:43:35 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-28270b0e-adec-4158-a074-003b7502cb7f req-4370ab91-cabb-42c7-982c-0e64a6fab578 service nova] Lock "3de2a41a-da2d-4531-a996-b57a637e163b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:43:35 user nova-compute[75285]: DEBUG nova.compute.manager [req-28270b0e-adec-4158-a074-003b7502cb7f req-4370ab91-cabb-42c7-982c-0e64a6fab578 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] No waiting events found dispatching network-vif-plugged-7e91a41b-b901-4e3f-9b04-f81f014d7276 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:43:35 user nova-compute[75285]: WARNING nova.compute.manager [req-28270b0e-adec-4158-a074-003b7502cb7f req-4370ab91-cabb-42c7-982c-0e64a6fab578 service nova] [instance: 3de2a41a-da2d-4531-a996-b57a637e163b] Received unexpected event network-vif-plugged-7e91a41b-b901-4e3f-9b04-f81f014d7276 for instance with vm_state deleted and task_state None.
Nov 10 21:43:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:43:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anPKktWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:43:53 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:43:53 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:43:53 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dec341f-d404-4a17-a2eb-f9de510bfcc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:43:53 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e594f86b-fb4c-4261-9f37-9cabdb21d14e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b] added
Nov 10 21:43:53 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf4a3db-5a64-4fc1-966c-37e61d5d28b8]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1ecce0-064a-4279-8f84-a649746f2793]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anPKktWT {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anPKktWT" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c8403c-24be-409d-aea2-dd5b5f1f038d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'anPKktWT'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f13039f-9d5f-4594-ba8a-f5c9ec67712f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0393168e-a5b6-4c3b-9a2e-bbdd6b63fe82]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:43:53 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:43:53 user nova-compute[75285]:  {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:43:53 user nova-compute[75285]: WARNING os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 21:43:53 user nova-compute[75285]: 
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c537e9f-1624-4948-9a45-504ec204b5b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b, portal: 172.16.0.220,3260]
Nov 10 21:43:53 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b, portal: 172.16.0.220,3260] successful.
Nov 10 21:43:53 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[24419440-3c82-415b-88dc-a0727767ddd1]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[415b1ee4-66e5-48b1-924e-6c2bbbf8fc56]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b (non-flash)
Nov 10 21:43:53 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b (non-flash)
Nov 10 21:43:53 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf21acc-c4d6-445c-aea7-b8364784ae32]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:43:53 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:43:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:54 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:43:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anPKktWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:43:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:43:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23630313932313939', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:43:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630313932313939', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:43:54 user nova-compute[75285]: DEBUG nova.objects.instance [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lazy-loading 'flavor' on Instance uuid 28bd82ee-0d5f-479b-a943-74e1a66d43ae {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:43:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:43:54 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:43:54 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:43:54 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:43:54 user nova-compute[75285]:   <serial>731e80ce-3033-4a2b-bec4-7c9c2d21352b</serial>
Nov 10 21:43:54 user nova-compute[75285]: </disk>
Nov 10 21:43:54 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:43:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:43:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:43:55 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] No VIF found with MAC fa:16:3e:0f:37:18, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:43:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d7c42257-cbef-441b-8990-f1515e263c78 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.641s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:43:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:43:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:43:56 user nova-compute[75285]: INFO nova.compute.manager [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Detaching volume 731e80ce-3033-4a2b-bec4-7c9c2d21352b
Nov 10 21:43:56 user nova-compute[75285]: INFO nova.virt.block_device [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Attempting to driver detach volume 731e80ce-3033-4a2b-bec4-7c9c2d21352b from mountpoint /dev/vdb
Nov 10 21:43:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Attempting to detach device vdb from instance 28bd82ee-0d5f-479b-a943-74e1a66d43ae from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:43:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:43:56 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:43:56 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:43:56 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:43:56 user nova-compute[75285]:   <serial>731e80ce-3033-4a2b-bec4-7c9c2d21352b</serial>
Nov 10 21:43:56 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:43:56 user nova-compute[75285]: </disk>
Nov 10 21:43:56 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:43:56 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Successfully detached device vdb from instance 28bd82ee-0d5f-479b-a943-74e1a66d43ae from the persistent domain config.
Nov 10 21:43:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28bd82ee-0d5f-479b-a943-74e1a66d43ae from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:43:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:43:56 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:43:56 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:43:56 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:43:56 user nova-compute[75285]:   <serial>731e80ce-3033-4a2b-bec4-7c9c2d21352b</serial>
Nov 10 21:43:56 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:43:56 user nova-compute[75285]: </disk>
Nov 10 21:43:56 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:43:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28bd82ee-0d5f-479b-a943-74e1a66d43ae {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:43:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:43:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:00 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:44:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:44:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:44:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:44:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:44:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:06 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:44:06 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 21:44:06 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] There are 0 instances to clean {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:09 user nova-compute[75285]: INFO nova.compute.manager [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Unshelving
Nov 10 21:44:09 user nova-compute[75285]: INFO nova.virt.block_device [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Booting with volume 8a7c5a89-9fff-423a-b0f0-ce6c402ce01c at /dev/vda
Nov 10 21:44:09 user nova-compute[75285]: DEBUG os_brick.utils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2528c176-a382-4e17-854a-e0cbeb0500f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b4c060-8ff0-49a0-b561-fb7cae8da511]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d013f4e3-4ea7-44b1-9c15-a932a0cb84f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdcad7d-054d-49ce-af2c-36f02b3cbce0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:44:09 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4442db3-76d5-4edc-8d59-d7e7fb804e30]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG os_brick.utils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updating existing volume attachment record: 82d366f0-ab3a-4a54-aa51-3b5f2825e28e {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:09 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:10 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:44:10 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:44:10 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8772MB free_disk=24.875289916992188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:44:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:10 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:44:10 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 28bd82ee-0d5f-479b-a943-74e1a66d43ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:44:10 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 082c9f75-1292-40d8-b6f4-c6737ee69b0f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 21:44:10 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:44:10 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:44:11 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing inventories for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 21:44:11 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating ProviderTree inventory for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 21:44:11 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating inventory in ProviderTree for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 21:44:11 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing aggregate associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, aggregates: None {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 21:44:11 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing trait associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 21:44:11 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:44:11 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:44:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:44:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:12 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:44:12 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:44:12 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 10 21:44:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-28bd82ee-0d5f-479b-a943-74e1a66d43ae" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:44:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-28bd82ee-0d5f-479b-a943-74e1a66d43ae" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:44:12 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:44:12 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Updating instance_info_cache with network_info: [{"id": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "address": "fa:16:3e:0f:37:18", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa199cd-51", "ovs_interfaceid": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:44:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-28bd82ee-0d5f-479b-a943-74e1a66d43ae" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:44:12 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:44:12 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:44:12 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:44:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:44:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:44:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:44:16 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 28bd82ee-0d5f-479b-a943-74e1a66d43ae is timed out.
Nov 10 21:44:16 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Successfully detached device vdb from instance 28bd82ee-0d5f-479b-a943-74e1a66d43ae from the live domain config.
Nov 10 21:44:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anPKktWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:44:16 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbd3fdf-1065-4f5d-8d80-49d4c6bcbbf2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:44:16 user nova-compute[75285]: No targets found.
Nov 10 21:44:16 user nova-compute[75285]: iSNS:
Nov 10 21:44:16 user nova-compute[75285]: No targets found.
Nov 10 21:44:16 user nova-compute[75285]: STATIC:
Nov 10 21:44:16 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b
Nov 10 21:44:16 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:44:16 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:44:16 user nova-compute[75285]: FIRMWARE:
Nov 10 21:44:16 user nova-compute[75285]: No targets found.
Nov 10 21:44:16 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:44:16 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:44:16 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e2ac28-f532-410c-bdbb-1251ff0e3744]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3792ea-2a94-42cd-9cc7-7f4757033334]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b (non-flash)
Nov 10 21:44:16 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b (non-flash)
Nov 10 21:44:16 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e45037f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4086850-64dd-47f2-a749-dc5c3ace107e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03ba1da-eb58-4427-afc0-4d7ef39c5159]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae4bc18-9b59-4f17-a669-b2e1757277fe]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[525403cd-1dd8-4772-aa75-92423df0603b]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b6c623-94ad-42e5-aa2b-74c7ebde72b5]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b69f626-f6dd-4356-9c33-d59797884196]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b, portal: 172.16.0.220,3260]
Nov 10 21:44:16 user nova-compute[75285]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b, portal: 172.16.0.220,3260] successful.
Nov 10 21:44:16 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731e80ce-3033-4a2b-bec4-7c9c2d21352b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd9106e-74ca-457d-95de-44f35fa0e0f4]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] <== disconnect_volume: return (311ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:44:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:44:17 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:44:17 user nova-compute[75285]: DEBUG nova.objects.instance [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lazy-loading 'flavor' on Instance uuid 28bd82ee-0d5f-479b-a943-74e1a66d43ae {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:44:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d1c90a87-edb3-4bc7-951c-00cf2a94ef45 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.995s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:44:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5123 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:44:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:44:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:44:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:44:26 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:44:28 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:44:28 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances with incomplete migration  {{(pid=75285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 21:44:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:44:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:32 user nova-compute[75285]: DEBUG nova.objects.instance [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lazy-loading 'pci_requests' on Instance uuid 082c9f75-1292-40d8-b6f4-c6737ee69b0f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:44:32 user nova-compute[75285]: DEBUG nova.objects.instance [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lazy-loading 'numa_topology' on Instance uuid 082c9f75-1292-40d8-b6f4-c6737ee69b0f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:44:32 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:44:32 user nova-compute[75285]: INFO nova.compute.claims [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Claim successful on node user
Nov 10 21:44:33 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:44:33 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:44:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:33 user nova-compute[75285]: INFO nova.network.neutron [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updating port 417a97b9-597b-430c-a7d4-5f66fe232e14 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 21:44:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:44:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquired lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:44:33 user nova-compute[75285]: DEBUG nova.network.neutron [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-09ed127f-e2d2-48f4-864d-32c9920b99a2 req-19111b52-753b-42e7-8be0-acd9ac734c92 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-changed-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-09ed127f-e2d2-48f4-864d-32c9920b99a2 req-19111b52-753b-42e7-8be0-acd9ac734c92 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Refreshing instance network info cache due to event network-changed-417a97b9-597b-430c-a7d4-5f66fe232e14. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-09ed127f-e2d2-48f4-864d-32c9920b99a2 req-19111b52-753b-42e7-8be0-acd9ac734c92 service nova] Acquiring lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.network.neutron [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updating instance_info_cache with network_info: [{"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Releasing lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:44:34 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Creating image(s)
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Did not create local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Ensure instance console log exists: /opt/stack/data/nova/instances/082c9f75-1292-40d8-b6f4-c6737ee69b0f/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Start _get_guest_xml network_info=[{"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '82d366f0-ab3a-4a54-aa51-3b5f2825e28e', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaRJOnBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '082c9f75-1292-40d8-b6f4-c6737ee69b0f', 'attached_at': '', 'detached_at': '', 'volume_id': '8a7c5a89-9fff-423a-b0f0-ce6c402ce01c', 'serial': '8a7c5a89-9fff-423a-b0f0-ce6c402ce01c'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-09ed127f-e2d2-48f4-864d-32c9920b99a2 req-19111b52-753b-42e7-8be0-acd9ac734c92 service nova] Acquired lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-09ed127f-e2d2-48f4-864d-32c9920b99a2 req-19111b52-753b-42e7-8be0-acd9ac734c92 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Refreshing network info cache for port 417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:44:34 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:44:34 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.objects.instance [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lazy-loading 'vcpu_model' on Instance uuid 082c9f75-1292-40d8-b6f4-c6737ee69b0f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.objects.base [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Object Instance<082c9f75-1292-40d8-b6f4-c6737ee69b0f> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaRJOnBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:44:34 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:44:34 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:44:34 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede381c3-537e-49f5-b99c-6bedfab3250e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:44:34 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[44711a16-98ad-4948-ae1b-b908a0f4f061]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c] added
Nov 10 21:44:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2a4872-5b7d-4684-b103-9f2a0d10fa5f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f5ed21-0742-4583-9de9-39080c05a50b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaRJOnBA {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaRJOnBA" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[36630b29-f198-4485-a6f9-31eb7c6f0160]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NaRJOnBA'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b683a1ac-696c-4a06-bff3-4d9a17a2b39f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e16fcd-00b5-4477-8282-554c5507297c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:44:34 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:44:34 user nova-compute[75285]:  {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:44:34 user nova-compute[75285]: WARNING os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 21:44:34 user nova-compute[75285]: 
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[019e7ec8-a429-4791-8150-4477766f28b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260]
Nov 10 21:44:34 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260] successful.
Nov 10 21:44:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbd0b9f-39e3-40d6-9107-db7526f0f528]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dc4860-e2fb-418d-8239-cd3ece5a061b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:44:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:44:34 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[012e8d3e-6373-468e-8122-b01aa06c0bf7]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-09ed127f-e2d2-48f4-864d-32c9920b99a2 req-19111b52-753b-42e7-8be0-acd9ac734c92 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updated VIF entry in instance network info cache for port 417a97b9-597b-430c-a7d4-5f66fe232e14. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG nova.network.neutron [req-09ed127f-e2d2-48f4-864d-32c9920b99a2 req-19111b52-753b-42e7-8be0-acd9ac734c92 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updating instance_info_cache with network_info: [{"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:44:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-09ed127f-e2d2-48f4-864d-32c9920b99a2 req-19111b52-753b-42e7-8be0-acd9ac734c92 service nova] Releasing lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaRJOnBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23939363962333133', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939363962333133', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T21:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-929483610',display_name='tempest-TestShelveInstance-server-929483610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-929483610',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-849712084',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:40:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e4dfd5b630c34fd7a61e8db5a71a60f6',ramdisk_id='',reservation_id='r-0f4w65xj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-141783322',owner_user_name='tempest-TestShelveInstance-141783322-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:44:09Z,user_data=None,user_id='d4e52746b7f24c08a3e1dae6e115b577',uuid=082c9f75-1292-40d8-b6f4-c6737ee69b0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Converting VIF {"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:d2:5d,bridge_name='br-int',has_traffic_filtering=True,id=417a97b9-597b-430c-a7d4-5f66fe232e14,network=Network(a01018d1-cd87-4d36-8484-9f198d21d38f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417a97b9-59') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG nova.objects.instance [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lazy-loading 'pci_devices' on Instance uuid 082c9f75-1292-40d8-b6f4-c6737ee69b0f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG nova.objects.base [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Object Instance<082c9f75-1292-40d8-b6f4-c6737ee69b0f> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:44:35 user nova-compute[75285]:   <uuid>082c9f75-1292-40d8-b6f4-c6737ee69b0f</uuid>
Nov 10 21:44:35 user nova-compute[75285]:   <name>instance-0000002e</name>
Nov 10 21:44:35 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:44:35 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:44:35 user nova-compute[75285]:   <metadata>
Nov 10 21:44:35 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:44:35 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:44:35 user nova-compute[75285]:       <nova:name>tempest-TestShelveInstance-server-929483610</nova:name>
Nov 10 21:44:35 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:44:34</nova:creationTime>
Nov 10 21:44:35 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:44:35 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:44:35 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:44:35 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:44:35 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:44:35 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:44:35 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:44:35 user nova-compute[75285]:       <nova:owner>
Nov 10 21:44:35 user nova-compute[75285]:         <nova:user uuid="d4e52746b7f24c08a3e1dae6e115b577">tempest-TestShelveInstance-141783322-project-member</nova:user>
Nov 10 21:44:35 user nova-compute[75285]:         <nova:project uuid="e4dfd5b630c34fd7a61e8db5a71a60f6">tempest-TestShelveInstance-141783322</nova:project>
Nov 10 21:44:35 user nova-compute[75285]:       </nova:owner>
Nov 10 21:44:35 user nova-compute[75285]:       <nova:ports>
Nov 10 21:44:35 user nova-compute[75285]:         <nova:port uuid="417a97b9-597b-430c-a7d4-5f66fe232e14">
Nov 10 21:44:35 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 21:44:35 user nova-compute[75285]:         </nova:port>
Nov 10 21:44:35 user nova-compute[75285]:       </nova:ports>
Nov 10 21:44:35 user nova-compute[75285]:     </nova:instance>
Nov 10 21:44:35 user nova-compute[75285]:   </metadata>
Nov 10 21:44:35 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:44:35 user nova-compute[75285]:     <system>
Nov 10 21:44:35 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:44:35 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:44:35 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:44:35 user nova-compute[75285]:       <entry name="serial">082c9f75-1292-40d8-b6f4-c6737ee69b0f</entry>
Nov 10 21:44:35 user nova-compute[75285]:       <entry name="uuid">082c9f75-1292-40d8-b6f4-c6737ee69b0f</entry>
Nov 10 21:44:35 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:44:35 user nova-compute[75285]:     </system>
Nov 10 21:44:35 user nova-compute[75285]:   </sysinfo>
Nov 10 21:44:35 user nova-compute[75285]:   <os>
Nov 10 21:44:35 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:44:35 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:44:35 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:44:35 user nova-compute[75285]:   </os>
Nov 10 21:44:35 user nova-compute[75285]:   <features>
Nov 10 21:44:35 user nova-compute[75285]:     <acpi/>
Nov 10 21:44:35 user nova-compute[75285]:     <apic/>
Nov 10 21:44:35 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:44:35 user nova-compute[75285]:   </features>
Nov 10 21:44:35 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:44:35 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:44:35 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:44:35 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:44:35 user nova-compute[75285]:   </clock>
Nov 10 21:44:35 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:44:35 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:44:35 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:44:35 user nova-compute[75285]:   </cpu>
Nov 10 21:44:35 user nova-compute[75285]:   <devices>
Nov 10 21:44:35 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:44:35 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:44:35 user nova-compute[75285]:       <source dev="/dev/sdb"/>
Nov 10 21:44:35 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:44:35 user nova-compute[75285]:       <serial>8a7c5a89-9fff-423a-b0f0-ce6c402ce01c</serial>
Nov 10 21:44:35 user nova-compute[75285]:     </disk>
Nov 10 21:44:35 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:44:35 user nova-compute[75285]:       <mac address="fa:16:3e:98:d2:5d"/>
Nov 10 21:44:35 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:44:35 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:44:35 user nova-compute[75285]:       <target dev="tap417a97b9-59"/>
Nov 10 21:44:35 user nova-compute[75285]:     </interface>
Nov 10 21:44:35 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:44:35 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/082c9f75-1292-40d8-b6f4-c6737ee69b0f/console.log" append="off"/>
Nov 10 21:44:35 user nova-compute[75285]:     </serial>
Nov 10 21:44:35 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:44:35 user nova-compute[75285]:     <video>
Nov 10 21:44:35 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:44:35 user nova-compute[75285]:     </video>
Nov 10 21:44:35 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:44:35 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:44:35 user nova-compute[75285]:     </rng>
Nov 10 21:44:35 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:44:35 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:44:35 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:44:35 user nova-compute[75285]:     </memballoon>
Nov 10 21:44:35 user nova-compute[75285]:   </devices>
Nov 10 21:44:35 user nova-compute[75285]: </domain>
Nov 10 21:44:35 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T21:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-929483610',display_name='tempest-TestShelveInstance-server-929483610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-929483610',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-849712084',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:40:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e4dfd5b630c34fd7a61e8db5a71a60f6',ramdisk_id='',reservation_id='r-0f4w65xj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-141783322',owner_user_name='tempest-TestShelveInstance-141783322-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:44:09Z,user_data=None,user_id='d4e52746b7f24c08a3e1dae6e115b577',uuid=082c9f75-1292-40d8-b6f4-c6737ee69b0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Converting VIF {"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:d2:5d,bridge_name='br-int',has_traffic_filtering=True,id=417a97b9-597b-430c-a7d4-5f66fe232e14,network=Network(a01018d1-cd87-4d36-8484-9f198d21d38f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417a97b9-59') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG os_vif [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:d2:5d,bridge_name='br-int',has_traffic_filtering=True,id=417a97b9-597b-430c-a7d4-5f66fe232e14,network=Network(a01018d1-cd87-4d36-8484-9f198d21d38f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417a97b9-59') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1acd375c-bd7f-531a-9251-4ea58ce4daf1', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap417a97b9-59, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap417a97b9-59, col_values=(('qos', UUID('a8840bd8-b0e8-4e0a-ada4-d62821f5202e')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap417a97b9-59, col_values=(('external_ids', {'iface-id': '417a97b9-597b-430c-a7d4-5f66fe232e14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:d2:5d', 'vm-uuid': '082c9f75-1292-40d8-b6f4-c6737ee69b0f'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:35 user nova-compute[75285]: INFO os_vif [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:d2:5d,bridge_name='br-int',has_traffic_filtering=True,id=417a97b9-597b-430c-a7d4-5f66fe232e14,network=Network(a01018d1-cd87-4d36-8484-9f198d21d38f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417a97b9-59')
Nov 10 21:44:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:44:35 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] No VIF found with MAC fa:16:3e:98:d2:5d, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:44:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-7bc60db0-fa48-402c-8877-2b7ad409839f req-59dcd098-2e75-4e09-9570-fb4d2b72db8d service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:44:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7bc60db0-fa48-402c-8877-2b7ad409839f req-59dcd098-2e75-4e09-9570-fb4d2b72db8d service nova] Acquiring lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7bc60db0-fa48-402c-8877-2b7ad409839f req-59dcd098-2e75-4e09-9570-fb4d2b72db8d service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:37 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7bc60db0-fa48-402c-8877-2b7ad409839f req-59dcd098-2e75-4e09-9570-fb4d2b72db8d service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:37 user nova-compute[75285]: DEBUG nova.compute.manager [req-7bc60db0-fa48-402c-8877-2b7ad409839f req-59dcd098-2e75-4e09-9570-fb4d2b72db8d service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] No waiting events found dispatching network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:44:37 user nova-compute[75285]: WARNING nova.compute.manager [req-7bc60db0-fa48-402c-8877-2b7ad409839f req-59dcd098-2e75-4e09-9570-fb4d2b72db8d service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received unexpected event network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 21:44:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:44:39 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:44:39 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Instance spawned successfully.
Nov 10 21:44:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:44:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-1a4ef2a3-42e0-4f32-8917-3e7c58b14b2e req-d53df5a8-1d33-4144-be46-a45acfbc9c3e service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:44:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1a4ef2a3-42e0-4f32-8917-3e7c58b14b2e req-d53df5a8-1d33-4144-be46-a45acfbc9c3e service nova] Acquiring lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1a4ef2a3-42e0-4f32-8917-3e7c58b14b2e req-d53df5a8-1d33-4144-be46-a45acfbc9c3e service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-1a4ef2a3-42e0-4f32-8917-3e7c58b14b2e req-d53df5a8-1d33-4144-be46-a45acfbc9c3e service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:39 user nova-compute[75285]: DEBUG nova.compute.manager [req-1a4ef2a3-42e0-4f32-8917-3e7c58b14b2e req-d53df5a8-1d33-4144-be46-a45acfbc9c3e service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] No waiting events found dispatching network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:44:39 user nova-compute[75285]: WARNING nova.compute.manager [req-1a4ef2a3-42e0-4f32-8917-3e7c58b14b2e req-d53df5a8-1d33-4144-be46-a45acfbc9c3e service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received unexpected event network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 21:44:39 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-79ebc9ab-6934-4a01-a8f1-f230fc8c7e74 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 30.688s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:46 user nova-compute[75285]: INFO nova.compute.manager [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Terminating instance
Nov 10 21:44:46 user nova-compute[75285]: DEBUG nova.compute.manager [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-5e7632ea-2de5-4149-ac2a-98bd38ae81d0 req-8ea4d9ad-c4fd-4693-aeb7-4690cca10ce5 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Received event network-vif-unplugged-baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e7632ea-2de5-4149-ac2a-98bd38ae81d0 req-8ea4d9ad-c4fd-4693-aeb7-4690cca10ce5 service nova] Acquiring lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e7632ea-2de5-4149-ac2a-98bd38ae81d0 req-8ea4d9ad-c4fd-4693-aeb7-4690cca10ce5 service nova] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5e7632ea-2de5-4149-ac2a-98bd38ae81d0 req-8ea4d9ad-c4fd-4693-aeb7-4690cca10ce5 service nova] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-5e7632ea-2de5-4149-ac2a-98bd38ae81d0 req-8ea4d9ad-c4fd-4693-aeb7-4690cca10ce5 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] No waiting events found dispatching network-vif-unplugged-baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:44:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-5e7632ea-2de5-4149-ac2a-98bd38ae81d0 req-8ea4d9ad-c4fd-4693-aeb7-4690cca10ce5 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Received event network-vif-unplugged-baa199cd-513c-4e4e-afdf-f76bbcb3db00 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:44:47 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Instance destroyed successfully.
Nov 10 21:44:47 user nova-compute[75285]: DEBUG nova.objects.instance [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lazy-loading 'resources' on Instance uuid 28bd82ee-0d5f-479b-a943-74e1a66d43ae {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:44:47 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1047738762',display_name='tempest-AttachVolumeNegativeTest-server-1047738762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1047738762',id=47,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaguy4lRHK7vEvB2sp44b3CJi5xOk+zka6rwNCiN9PObIr/DK+0IGqusxNOPhfQd6tQfuJC9sSAAOcuVWB0/5RPO4nBOialIlw2nMVEE4p+Ka0/t8CEU+XDXHwKXClq0w==',key_name='tempest-keypair-536378706',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:41:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96f56b3b4b3e465f97cf07aa338a57a9',ramdisk_id='',reservation_id='r-fbt8zgw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-377835946',owner_user_name='tempest-AttachVolumeNegativeTest-377835946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7762d2ba25d4427ae7ed839e2bbbde4',uuid=28bd82ee-0d5f-479b-a943-74e1a66d43ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "address": "fa:16:3e:0f:37:18", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa199cd-51", "ovs_interfaceid": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:44:47 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converting VIF {"id": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "address": "fa:16:3e:0f:37:18", "network": {"id": "890bbbfc-499e-465d-9ff9-df037628911f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1342950394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96f56b3b4b3e465f97cf07aa338a57a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa199cd-51", "ovs_interfaceid": "baa199cd-513c-4e4e-afdf-f76bbcb3db00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:44:47 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:37:18,bridge_name='br-int',has_traffic_filtering=True,id=baa199cd-513c-4e4e-afdf-f76bbcb3db00,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa199cd-51') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:44:47 user nova-compute[75285]: DEBUG os_vif [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:37:18,bridge_name='br-int',has_traffic_filtering=True,id=baa199cd-513c-4e4e-afdf-f76bbcb3db00,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa199cd-51') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:44:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbaa199cd-51, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:44:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:44:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df41f8d3-ef68-4364-bb10-25ebff433a16) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:44:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:47 user nova-compute[75285]: INFO os_vif [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:37:18,bridge_name='br-int',has_traffic_filtering=True,id=baa199cd-513c-4e4e-afdf-f76bbcb3db00,network=Network(890bbbfc-499e-465d-9ff9-df037628911f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa199cd-51')
Nov 10 21:44:47 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Deleting instance files /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae_del
Nov 10 21:44:47 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Deletion of /opt/stack/data/nova/instances/28bd82ee-0d5f-479b-a943-74e1a66d43ae_del complete
Nov 10 21:44:47 user nova-compute[75285]: INFO nova.compute.manager [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 10 21:44:47 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:44:47 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:44:47 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:44:48 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:44:48 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Took 1.00 seconds to deallocate network for instance.
Nov 10 21:44:48 user nova-compute[75285]: DEBUG nova.compute.manager [req-1ee32955-12de-401d-b395-3ad58770d103 req-95b4145f-8cf0-4eff-8146-622c28f8f333 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Received event network-vif-deleted-baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:44:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:48 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:44:48 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:44:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:48 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Deleted allocations for instance 28bd82ee-0d5f-479b-a943-74e1a66d43ae
Nov 10 21:44:48 user nova-compute[75285]: DEBUG nova.compute.manager [req-fe9529e8-603c-4437-9f3e-ec5e2e73ffa8 req-90f92f9c-34c4-419c-875a-9e9ac8ec4630 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Received event network-vif-plugged-baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:44:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fe9529e8-603c-4437-9f3e-ec5e2e73ffa8 req-90f92f9c-34c4-419c-875a-9e9ac8ec4630 service nova] Acquiring lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fe9529e8-603c-4437-9f3e-ec5e2e73ffa8 req-90f92f9c-34c4-419c-875a-9e9ac8ec4630 service nova] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fe9529e8-603c-4437-9f3e-ec5e2e73ffa8 req-90f92f9c-34c4-419c-875a-9e9ac8ec4630 service nova] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:48 user nova-compute[75285]: DEBUG nova.compute.manager [req-fe9529e8-603c-4437-9f3e-ec5e2e73ffa8 req-90f92f9c-34c4-419c-875a-9e9ac8ec4630 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] No waiting events found dispatching network-vif-plugged-baa199cd-513c-4e4e-afdf-f76bbcb3db00 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:44:48 user nova-compute[75285]: WARNING nova.compute.manager [req-fe9529e8-603c-4437-9f3e-ec5e2e73ffa8 req-90f92f9c-34c4-419c-875a-9e9ac8ec4630 service nova] [instance: 28bd82ee-0d5f-479b-a943-74e1a66d43ae] Received unexpected event network-vif-plugged-baa199cd-513c-4e4e-afdf-f76bbcb3db00 for instance with vm_state deleted and task_state None.
Nov 10 21:44:48 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-a1f40e34-4d3c-449f-9810-0c6916704c54 tempest-AttachVolumeNegativeTest-377835946 tempest-AttachVolumeNegativeTest-377835946-project-member] Lock "28bd82ee-0d5f-479b-a943-74e1a66d43ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.370s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:49 user nova-compute[75285]: INFO nova.compute.manager [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Terminating instance
Nov 10 21:44:49 user nova-compute[75285]: DEBUG nova.compute.manager [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG nova.compute.manager [req-5c974e50-27fa-494a-bfe8-0c8bd30145e9 req-d2c59acd-d4c9-4810-acc7-feb845edd1e8 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Received event network-vif-unplugged-824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5c974e50-27fa-494a-bfe8-0c8bd30145e9 req-d2c59acd-d4c9-4810-acc7-feb845edd1e8 service nova] Acquiring lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5c974e50-27fa-494a-bfe8-0c8bd30145e9 req-d2c59acd-d4c9-4810-acc7-feb845edd1e8 service nova] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5c974e50-27fa-494a-bfe8-0c8bd30145e9 req-d2c59acd-d4c9-4810-acc7-feb845edd1e8 service nova] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG nova.compute.manager [req-5c974e50-27fa-494a-bfe8-0c8bd30145e9 req-d2c59acd-d4c9-4810-acc7-feb845edd1e8 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] No waiting events found dispatching network-vif-unplugged-824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG nova.compute.manager [req-5c974e50-27fa-494a-bfe8-0c8bd30145e9 req-d2c59acd-d4c9-4810-acc7-feb845edd1e8 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Received event network-vif-unplugged-824fc651-afa7-43bf-b81b-4f4a441c664b for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:49 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Instance destroyed successfully.
Nov 10 21:44:49 user nova-compute[75285]: DEBUG nova.objects.instance [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lazy-loading 'resources' on Instance uuid b50a2144-75e2-4124-9be7-7c5f9a5ce647 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1258895728',display_name='tempest-TestStampPattern-server-1258895728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1258895728',id=42,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDesKwnov6nE2ld9TlR2fU3g0q2iM+VKiUlmhK8jP1iPmNHB6lDKQy4ay9Gx6aPViDAsMciHIGIxIzSorT0IkxMhTgbfUY9SEgK+3RievcFZ227mhE1qSONbcnrF6fHmFg==',key_name='tempest-TestStampPattern-930691110',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:36:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='362608e7cf3b4c1fb9dc6187091b3dbb',ramdisk_id='',reservation_id='r-w4by6ug0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-248662818',owner_user_name='tempest-TestStampPattern-248662818-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:40:21Z,user_data=None,user_id='4b47da8e21f44b98aec923a5bf71b361',uuid=b50a2144-75e2-4124-9be7-7c5f9a5ce647,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Converting VIF {"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:50:9b,bridge_name='br-int',has_traffic_filtering=True,id=824fc651-afa7-43bf-b81b-4f4a441c664b,network=Network(f2a1706e-9d15-46ca-93a2-9fb70223a9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap824fc651-af') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG os_vif [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:50:9b,bridge_name='br-int',has_traffic_filtering=True,id=824fc651-afa7-43bf-b81b-4f4a441c664b,network=Network(f2a1706e-9d15-46ca-93a2-9fb70223a9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap824fc651-af') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap824fc651-af, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3222c3f-ec31-454f-9380-bab83c5124c2) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:49 user nova-compute[75285]: INFO os_vif [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:50:9b,bridge_name='br-int',has_traffic_filtering=True,id=824fc651-afa7-43bf-b81b-4f4a441c664b,network=Network(f2a1706e-9d15-46ca-93a2-9fb70223a9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap824fc651-af')
Nov 10 21:44:49 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Deleting instance files /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647_del
Nov 10 21:44:49 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Deletion of /opt/stack/data/nova/instances/b50a2144-75e2-4124-9be7-7c5f9a5ce647_del complete
Nov 10 21:44:50 user nova-compute[75285]: INFO nova.compute.manager [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 10 21:44:50 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:44:50 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:44:50 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:44:50 user nova-compute[75285]: DEBUG nova.compute.manager [req-57ffd49e-94e1-49f9-9d8b-89284bca97bb req-dc4e799a-47df-46f9-85c4-dd20def635fd service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Received event network-changed-824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:44:50 user nova-compute[75285]: DEBUG nova.compute.manager [req-57ffd49e-94e1-49f9-9d8b-89284bca97bb req-dc4e799a-47df-46f9-85c4-dd20def635fd service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Refreshing instance network info cache due to event network-changed-824fc651-afa7-43bf-b81b-4f4a441c664b. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:44:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-57ffd49e-94e1-49f9-9d8b-89284bca97bb req-dc4e799a-47df-46f9-85c4-dd20def635fd service nova] Acquiring lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:44:50 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-57ffd49e-94e1-49f9-9d8b-89284bca97bb req-dc4e799a-47df-46f9-85c4-dd20def635fd service nova] Acquired lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:44:50 user nova-compute[75285]: DEBUG nova.network.neutron [req-57ffd49e-94e1-49f9-9d8b-89284bca97bb req-dc4e799a-47df-46f9-85c4-dd20def635fd service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Refreshing network info cache for port 824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:44:51 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:44:51 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Took 1.02 seconds to deallocate network for instance.
Nov 10 21:44:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:51 user nova-compute[75285]: DEBUG nova.network.neutron [req-57ffd49e-94e1-49f9-9d8b-89284bca97bb req-dc4e799a-47df-46f9-85c4-dd20def635fd service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updated VIF entry in instance network info cache for port 824fc651-afa7-43bf-b81b-4f4a441c664b. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:44:51 user nova-compute[75285]: DEBUG nova.network.neutron [req-57ffd49e-94e1-49f9-9d8b-89284bca97bb req-dc4e799a-47df-46f9-85c4-dd20def635fd service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Updating instance_info_cache with network_info: [{"id": "824fc651-afa7-43bf-b81b-4f4a441c664b", "address": "fa:16:3e:7e:50:9b", "network": {"id": "f2a1706e-9d15-46ca-93a2-9fb70223a9d7", "bridge": "br-int", "label": "tempest-TestStampPattern-2040922593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362608e7cf3b4c1fb9dc6187091b3dbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap824fc651-af", "ovs_interfaceid": "824fc651-afa7-43bf-b81b-4f4a441c664b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:44:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-57ffd49e-94e1-49f9-9d8b-89284bca97bb req-dc4e799a-47df-46f9-85c4-dd20def635fd service nova] Releasing lock "refresh_cache-b50a2144-75e2-4124-9be7-7c5f9a5ce647" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:44:51 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:44:51 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:44:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:51 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Deleted allocations for instance b50a2144-75e2-4124-9be7-7c5f9a5ce647
Nov 10 21:44:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-1be80135-24f5-49a8-b584-4c13e2c11164 tempest-TestStampPattern-248662818 tempest-TestStampPattern-248662818-project-member] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.280s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:51 user nova-compute[75285]: DEBUG nova.compute.manager [req-4c840a41-b76a-4651-a032-84f335fffcdd req-47009cea-d634-42ef-94eb-47e4ecff0739 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Received event network-vif-plugged-824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:44:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4c840a41-b76a-4651-a032-84f335fffcdd req-47009cea-d634-42ef-94eb-47e4ecff0739 service nova] Acquiring lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:44:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4c840a41-b76a-4651-a032-84f335fffcdd req-47009cea-d634-42ef-94eb-47e4ecff0739 service nova] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:44:51 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4c840a41-b76a-4651-a032-84f335fffcdd req-47009cea-d634-42ef-94eb-47e4ecff0739 service nova] Lock "b50a2144-75e2-4124-9be7-7c5f9a5ce647-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:44:51 user nova-compute[75285]: DEBUG nova.compute.manager [req-4c840a41-b76a-4651-a032-84f335fffcdd req-47009cea-d634-42ef-94eb-47e4ecff0739 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] No waiting events found dispatching network-vif-plugged-824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:44:51 user nova-compute[75285]: WARNING nova.compute.manager [req-4c840a41-b76a-4651-a032-84f335fffcdd req-47009cea-d634-42ef-94eb-47e4ecff0739 service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Received unexpected event network-vif-plugged-824fc651-afa7-43bf-b81b-4f4a441c664b for instance with vm_state deleted and task_state None.
Nov 10 21:44:52 user nova-compute[75285]: DEBUG nova.compute.manager [req-47c2fbeb-a6b0-4787-b83e-1a410a842472 req-197e1b8c-ecf1-4f82-ab90-e2597941e9cd service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Received event network-vif-deleted-824fc651-afa7-43bf-b81b-4f4a441c664b {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:44:52 user nova-compute[75285]: INFO nova.compute.manager [req-47c2fbeb-a6b0-4787-b83e-1a410a842472 req-197e1b8c-ecf1-4f82-ab90-e2597941e9cd service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Neutron deleted interface 824fc651-afa7-43bf-b81b-4f4a441c664b; detaching it from the instance and deleting it from the info cache
Nov 10 21:44:52 user nova-compute[75285]: DEBUG nova.network.neutron [req-47c2fbeb-a6b0-4787-b83e-1a410a842472 req-197e1b8c-ecf1-4f82-ab90-e2597941e9cd service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Instance is deleted, no further info cache update {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Nov 10 21:44:52 user nova-compute[75285]: DEBUG nova.compute.manager [req-47c2fbeb-a6b0-4787-b83e-1a410a842472 req-197e1b8c-ecf1-4f82-ab90-e2597941e9cd service nova] [instance: b50a2144-75e2-4124-9be7-7c5f9a5ce647] Detach interface failed, port_id=824fc651-afa7-43bf-b81b-4f4a441c664b, reason: Instance b50a2144-75e2-4124-9be7-7c5f9a5ce647 could not be found. {{(pid=75285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 21:44:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:44:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:01 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:45:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:45:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:45:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:45:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:45:09 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:45:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:45:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:10 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:45:10 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:45:10 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8867MB free_disk=25.02532958984375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:45:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:45:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:45:10 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 082c9f75-1292-40d8-b6f4-c6737ee69b0f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:45:10 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:45:10 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:45:10 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:45:10 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:45:10 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:45:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:45:11 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:45:11 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:45:11 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:45:11 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:45:11 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:45:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:45:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:45:11 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:45:11 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid 082c9f75-1292-40d8-b6f4-c6737ee69b0f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:45:12 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updating instance_info_cache with network_info: [{"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:45:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:45:12 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:45:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:13 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:45:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:16 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:45:16 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:45:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:45:19 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:45:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:45:20 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:45:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:45:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:45:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:45:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:45:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:45:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:45:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:45:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:45:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:45:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:45:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:45:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:45:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:46:00 user nova-compute[75285]: INFO nova.compute.manager [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Terminating instance
Nov 10 21:46:00 user nova-compute[75285]: DEBUG nova.compute.manager [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-bb4f90ee-aa94-4d0f-91bc-925d7b3a641e req-30ebefb1-29db-4251-a3a0-ad54ecbe7ca1 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-changed-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-bb4f90ee-aa94-4d0f-91bc-925d7b3a641e req-30ebefb1-29db-4251-a3a0-ad54ecbe7ca1 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Refreshing instance network info cache due to event network-changed-417a97b9-597b-430c-a7d4-5f66fe232e14. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bb4f90ee-aa94-4d0f-91bc-925d7b3a641e req-30ebefb1-29db-4251-a3a0-ad54ecbe7ca1 service nova] Acquiring lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bb4f90ee-aa94-4d0f-91bc-925d7b3a641e req-30ebefb1-29db-4251-a3a0-ad54ecbe7ca1 service nova] Acquired lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG nova.network.neutron [req-bb4f90ee-aa94-4d0f-91bc-925d7b3a641e req-30ebefb1-29db-4251-a3a0-ad54ecbe7ca1 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Refreshing network info cache for port 417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-8698a9ae-1734-43c8-9c5e-8d20d9dd945b req-0066eefc-7e5c-4feb-af25-ede91a50d960 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-vif-unplugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8698a9ae-1734-43c8-9c5e-8d20d9dd945b req-0066eefc-7e5c-4feb-af25-ede91a50d960 service nova] Acquiring lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8698a9ae-1734-43c8-9c5e-8d20d9dd945b req-0066eefc-7e5c-4feb-af25-ede91a50d960 service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-8698a9ae-1734-43c8-9c5e-8d20d9dd945b req-0066eefc-7e5c-4feb-af25-ede91a50d960 service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-8698a9ae-1734-43c8-9c5e-8d20d9dd945b req-0066eefc-7e5c-4feb-af25-ede91a50d960 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] No waiting events found dispatching network-vif-unplugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-8698a9ae-1734-43c8-9c5e-8d20d9dd945b req-0066eefc-7e5c-4feb-af25-ede91a50d960 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-vif-unplugged-417a97b9-597b-430c-a7d4-5f66fe232e14 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG nova.network.neutron [req-bb4f90ee-aa94-4d0f-91bc-925d7b3a641e req-30ebefb1-29db-4251-a3a0-ad54ecbe7ca1 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updated VIF entry in instance network info cache for port 417a97b9-597b-430c-a7d4-5f66fe232e14. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG nova.network.neutron [req-bb4f90ee-aa94-4d0f-91bc-925d7b3a641e req-30ebefb1-29db-4251-a3a0-ad54ecbe7ca1 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updating instance_info_cache with network_info: [{"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bb4f90ee-aa94-4d0f-91bc-925d7b3a641e req-30ebefb1-29db-4251-a3a0-ad54ecbe7ca1 service nova] Releasing lock "refresh_cache-082c9f75-1292-40d8-b6f4-c6737ee69b0f" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:46:00 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Instance destroyed successfully.
Nov 10 21:46:00 user nova-compute[75285]: DEBUG nova.objects.instance [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lazy-loading 'resources' on Instance uuid 082c9f75-1292-40d8-b6f4-c6737ee69b0f {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T21:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-929483610',display_name='tempest-TestShelveInstance-server-929483610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-929483610',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSoQCpYiHZSWq/7GN6lb2pD1fVkKInwCnijnYQCiTa6k5mU+9olVg72UFswbMyOeQ8xzObBsT8A2Bm+d+qtf3g9MqlbvDPbCPUeqQDLjq3fXPF/XKU7t33F1gzDariB7Q==',key_name='tempest-TestShelveInstance-849712084',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:44:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4dfd5b630c34fd7a61e8db5a71a60f6',ramdisk_id='',reservation_id='r-0f4w65xj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-141783322',owner_user_name='tempest-TestShelveInstance-141783322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:44:40Z,user_data=None,user_id='d4e52746b7f24c08a3e1dae6e115b577',uuid=082c9f75-1292-40d8-b6f4-c6737ee69b0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Converting VIF {"id": "417a97b9-597b-430c-a7d4-5f66fe232e14", "address": "fa:16:3e:98:d2:5d", "network": {"id": "a01018d1-cd87-4d36-8484-9f198d21d38f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1700431135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4dfd5b630c34fd7a61e8db5a71a60f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417a97b9-59", "ovs_interfaceid": "417a97b9-597b-430c-a7d4-5f66fe232e14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:d2:5d,bridge_name='br-int',has_traffic_filtering=True,id=417a97b9-597b-430c-a7d4-5f66fe232e14,network=Network(a01018d1-cd87-4d36-8484-9f198d21d38f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417a97b9-59') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG os_vif [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:d2:5d,bridge_name='br-int',has_traffic_filtering=True,id=417a97b9-597b-430c-a7d4-5f66fe232e14,network=Network(a01018d1-cd87-4d36-8484-9f198d21d38f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417a97b9-59') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap417a97b9-59, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8840bd8-b0e8-4e0a-ada4-d62821f5202e) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:46:00 user nova-compute[75285]: INFO os_vif [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:d2:5d,bridge_name='br-int',has_traffic_filtering=True,id=417a97b9-597b-430c-a7d4-5f66fe232e14,network=Network(a01018d1-cd87-4d36-8484-9f198d21d38f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417a97b9-59')
Nov 10 21:46:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaRJOnBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:46:00 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:46:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[093f63ea-d178-4f78-a3da-737287b0932d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:46:00 user nova-compute[75285]: No targets found.
Nov 10 21:46:00 user nova-compute[75285]: iSNS:
Nov 10 21:46:00 user nova-compute[75285]: No targets found.
Nov 10 21:46:00 user nova-compute[75285]: STATIC:
Nov 10 21:46:00 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c
Nov 10 21:46:00 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:46:00 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:46:00 user nova-compute[75285]: FIRMWARE:
Nov 10 21:46:00 user nova-compute[75285]: No targets found.
Nov 10 21:46:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:46:00 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:46:00 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae0d3f1-dcb0-49f1-a518-349f08a98ac9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f15744-3620-4c44-82d1-aee2e3743a0d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:46:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c (non-flash)
Nov 10 21:46:00 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e45500d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf3737c-9c77-4675-b6f7-3c003b120b6f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:46:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59a34eb-2303-4550-bb98-c62a7d7af9bb]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9477f8-5ebc-4220-9d3b-20da12689834]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72ab7cf-18c3-46e9-aeaa-d3020c079d13]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOec501697-9969b31399fb01f8', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ec501697', '/dev/disk/by-id/scsi-23939363962333133') {{(pid=86427) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4493301a-bdfb-4c22-a9fc-a77dc5688ab5]: (4, None) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[904a421e-6d42-4949-9c78-819adcd82f2c]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7097242-1772-4b0b-a32b-86360dd128df]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260]
Nov 10 21:46:01 user nova-compute[75285]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c, portal: 172.16.0.220,3260] successful.
Nov 10 21:46:01 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7c5a89-9fff-423a-b0f0-ce6c402ce01c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[893a513b-eb8a-4c54-b635-3cc9a5f84ec6]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] <== disconnect_volume: return (326ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:46:01 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Deleting instance files /opt/stack/data/nova/instances/082c9f75-1292-40d8-b6f4-c6737ee69b0f_del
Nov 10 21:46:01 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Deletion of /opt/stack/data/nova/instances/082c9f75-1292-40d8-b6f4-c6737ee69b0f_del complete
Nov 10 21:46:01 user nova-compute[75285]: INFO nova.compute.manager [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:46:01 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:46:01 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Took 0.51 seconds to deallocate network for instance.
Nov 10 21:46:02 user nova-compute[75285]: DEBUG nova.compute.manager [req-d99ea7e9-72bc-4359-80c6-6a3847c90785 req-db5a2415-3b40-4352-9607-acf67e3cddd5 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-vif-deleted-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:46:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:02 user nova-compute[75285]: DEBUG nova.compute.manager [req-007c53b1-aa60-45d0-af7e-f23cd7202b82 req-293241db-ff27-4eb8-a6b8-d62d4f2b7616 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received event network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:46:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-007c53b1-aa60-45d0-af7e-f23cd7202b82 req-293241db-ff27-4eb8-a6b8-d62d4f2b7616 service nova] Acquiring lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:46:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-007c53b1-aa60-45d0-af7e-f23cd7202b82 req-293241db-ff27-4eb8-a6b8-d62d4f2b7616 service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:46:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-007c53b1-aa60-45d0-af7e-f23cd7202b82 req-293241db-ff27-4eb8-a6b8-d62d4f2b7616 service nova] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:46:02 user nova-compute[75285]: DEBUG nova.compute.manager [req-007c53b1-aa60-45d0-af7e-f23cd7202b82 req-293241db-ff27-4eb8-a6b8-d62d4f2b7616 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] No waiting events found dispatching network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:46:02 user nova-compute[75285]: WARNING nova.compute.manager [req-007c53b1-aa60-45d0-af7e-f23cd7202b82 req-293241db-ff27-4eb8-a6b8-d62d4f2b7616 service nova] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Received unexpected event network-vif-plugged-417a97b9-597b-430c-a7d4-5f66fe232e14 for instance with vm_state active and task_state deleting.
Nov 10 21:46:02 user nova-compute[75285]: INFO nova.compute.manager [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Took 1.01 seconds to detach 1 volumes for instance.
Nov 10 21:46:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] [instance: 082c9f75-1292-40d8-b6f4-c6737ee69b0f] Deleting volume: 8a7c5a89-9fff-423a-b0f0-ce6c402ce01c {{(pid=75285) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 21:46:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:46:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:46:03 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:46:03 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:46:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:46:03 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Deleted allocations for instance 082c9f75-1292-40d8-b6f4-c6737ee69b0f
Nov 10 21:46:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-d2f953f2-4f46-4b56-bac7-7676bc813920 tempest-TestShelveInstance-141783322 tempest-TestShelveInstance-141783322-project-member] Lock "082c9f75-1292-40d8-b6f4-c6737ee69b0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.206s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:46:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:46:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:46:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:46:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:46:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:46:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:46:10 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:46:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:11 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:46:11 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:46:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8996MB free_disk=25.022109985351562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:46:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:46:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:46:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:46:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:46:11 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:46:11 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:46:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:46:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:46:13 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:46:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:46:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:46:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Didn't find any instances for network info cache update. {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 21:46:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:46:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:16 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:46:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:18 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:46:18 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:46:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:21 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:46:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:46:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:03 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:47:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "db49b877-4758-467f-82a7-7ebc25489972" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:47:09 user nova-compute[75285]: INFO nova.compute.claims [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Claim successful on node user
Nov 10 21:47:09 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:47:09 user nova-compute[75285]: INFO nova.compute.claims [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Claim successful on node user
Nov 10 21:47:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:47:09 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:47:09 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:47:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG nova.policy [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'face290806c0494b956c6574c086fda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5be8bdaa0904649a3942a800ab22520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:47:10 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Creating image(s)
Nov 10 21:47:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "/opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "/opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "/opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "3be78df82ffbc6a53d4ff719d33811a1237f2f72" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "3be78df82ffbc6a53d4ff719d33811a1237f2f72" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72.part --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.830s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG nova.network.neutron [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:47:10 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:47:10 user nova-compute[75285]: DEBUG nova.compute.manager [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72.part --force-share --output=json" returned: 0 in 0.229s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG nova.virt.images [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] b2824634-ff9e-4ae5-9da6-b66d3f04d1dc was qcow2, converting to raw {{(pid=75285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:47:10 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72.part /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72.converted {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG nova.compute.manager [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:47:11 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Creating image(s)
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "/opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "/opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "/opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72.part /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72.converted" returned: 0 in 0.237s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72.converted --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.225s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72.converted --force-share --output=json" returned: 0 in 0.231s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "3be78df82ffbc6a53d4ff719d33811a1237f2f72" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.225s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.195s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1,backing_fmt=raw /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk 1073741824" returned: 0 in 0.062s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "9f11daa83b3f1abc3336c0af587b96a9e07402a1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG nova.policy [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7785cf2c3a6046cda94bba0bc3d9301d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13cd60442854c50b825af9e6f70d18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Successfully created port: bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72 --force-share --output=json" returned: 0 in 0.281s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "3be78df82ffbc6a53d4ff719d33811a1237f2f72" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "3be78df82ffbc6a53d4ff719d33811a1237f2f72" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:11 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11daa83b3f1abc3336c0af587b96a9e07402a1 --force-share --output=json" returned: 0 in 0.584s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72 --force-share --output=json" returned: 0 in 0.498s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72,backing_fmt=raw /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:47:12 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:47:12 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=24.947731018066406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72,backing_fmt=raw /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk 1073741824" returned: 0 in 0.079s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "3be78df82ffbc6a53d4ff719d33811a1237f2f72" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.619s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Cannot resize image /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Ensure instance console log exists: /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance db49b877-4758-467f-82a7-7ebc25489972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 4883d7cc-ee48-42d6-aecc-82e68f203441 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72 --force-share --output=json" returned: 0 in 0.205s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Cannot resize image /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Ensure instance console log exists: /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Successfully updated port: bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquired lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.compute.manager [req-7a0074ff-6442-4154-b4cb-07843ab105d7 req-785c3058-caba-47db-a217-555fc40f7ab6 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-changed-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.compute.manager [req-7a0074ff-6442-4154-b4cb-07843ab105d7 req-785c3058-caba-47db-a217-555fc40f7ab6 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Refreshing instance network info cache due to event network-changed-bf303f2b-484f-4bb9-8f64-e546ee08ea57. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7a0074ff-6442-4154-b4cb-07843ab105d7 req-785c3058-caba-47db-a217-555fc40f7ab6 service nova] Acquiring lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:47:12 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.network.neutron [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updating instance_info_cache with network_info: [{"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.network.neutron [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Successfully created port: 32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Releasing lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Instance network_info: |[{"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7a0074ff-6442-4154-b4cb-07843ab105d7 req-785c3058-caba-47db-a217-555fc40f7ab6 service nova] Acquired lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.network.neutron [req-7a0074ff-6442-4154-b4cb-07843ab105d7 req-785c3058-caba-47db-a217-555fc40f7ab6 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Refreshing network info cache for port bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Start _get_guest_xml network_info=[{"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T21:47:05Z,direct_url=<?>,disk_format='qcow2',id=b2824634-ff9e-4ae5-9da6-b66d3f04d1dc,min_disk=0,min_ram=0,name='tempest-scenario-img--192765097',owner='c5be8bdaa0904649a3942a800ab22520',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T21:47:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b2824634-ff9e-4ae5-9da6-b66d3f04d1dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:47:13 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:47:13 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T21:47:05Z,direct_url=<?>,disk_format='qcow2',id=b2824634-ff9e-4ae5-9da6-b66d3f04d1dc,min_disk=0,min_ram=0,name='tempest-scenario-img--192765097',owner='c5be8bdaa0904649a3942a800ab22520',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T21:47:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1664109897',display_name='tempest-TestMinimumBasicScenario-server-1664109897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1664109897',id=48,image_ref='b2824634-ff9e-4ae5-9da6-b66d3f04d1dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuVMYmNRx64Pj7St2vh0O+0SlHGGlAdvL6wrmO53jHjMBiD/xn7M1S7npOfjsPKn1tR47m1uzoKo8UVzlR3nLHkXdGDp3ZuOFtAKQkBjk0u+ctBgPCmISWi1+ZXIlHY0w==',key_name='tempest-TestMinimumBasicScenario-1404195034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5be8bdaa0904649a3942a800ab22520',ramdisk_id='',reservation_id='r-5irnhmq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b2824634-ff9e-4ae5-9da6-b66d3f04d1dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-546154678',owner_user_name='tempest-TestMinimumBasicScenario-546154678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:47:10Z,user_data=None,user_id='face290806c0494b956c6574c086fda8',uuid=db49b877-4758-467f-82a7-7ebc25489972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converting VIF {"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf303f2b-484f-4bb9-8f64-e546ee08ea57,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf303f2b-48') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'pci_devices' on Instance uuid db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:47:13 user nova-compute[75285]:   <uuid>db49b877-4758-467f-82a7-7ebc25489972</uuid>
Nov 10 21:47:13 user nova-compute[75285]:   <name>instance-00000030</name>
Nov 10 21:47:13 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:47:13 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:47:13 user nova-compute[75285]:   <metadata>
Nov 10 21:47:13 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:47:13 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:47:13 user nova-compute[75285]:       <nova:name>tempest-TestMinimumBasicScenario-server-1664109897</nova:name>
Nov 10 21:47:13 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:47:13</nova:creationTime>
Nov 10 21:47:13 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:47:13 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:47:13 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:47:13 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:47:13 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:47:13 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:47:13 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:47:13 user nova-compute[75285]:       <nova:owner>
Nov 10 21:47:13 user nova-compute[75285]:         <nova:user uuid="face290806c0494b956c6574c086fda8">tempest-TestMinimumBasicScenario-546154678-project-member</nova:user>
Nov 10 21:47:13 user nova-compute[75285]:         <nova:project uuid="c5be8bdaa0904649a3942a800ab22520">tempest-TestMinimumBasicScenario-546154678</nova:project>
Nov 10 21:47:13 user nova-compute[75285]:       </nova:owner>
Nov 10 21:47:13 user nova-compute[75285]:       <nova:root type="image" uuid="b2824634-ff9e-4ae5-9da6-b66d3f04d1dc"/>
Nov 10 21:47:13 user nova-compute[75285]:       <nova:ports>
Nov 10 21:47:13 user nova-compute[75285]:         <nova:port uuid="bf303f2b-484f-4bb9-8f64-e546ee08ea57">
Nov 10 21:47:13 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 21:47:13 user nova-compute[75285]:         </nova:port>
Nov 10 21:47:13 user nova-compute[75285]:       </nova:ports>
Nov 10 21:47:13 user nova-compute[75285]:     </nova:instance>
Nov 10 21:47:13 user nova-compute[75285]:   </metadata>
Nov 10 21:47:13 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:47:13 user nova-compute[75285]:     <system>
Nov 10 21:47:13 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:47:13 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:47:13 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:47:13 user nova-compute[75285]:       <entry name="serial">db49b877-4758-467f-82a7-7ebc25489972</entry>
Nov 10 21:47:13 user nova-compute[75285]:       <entry name="uuid">db49b877-4758-467f-82a7-7ebc25489972</entry>
Nov 10 21:47:13 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:47:13 user nova-compute[75285]:     </system>
Nov 10 21:47:13 user nova-compute[75285]:   </sysinfo>
Nov 10 21:47:13 user nova-compute[75285]:   <os>
Nov 10 21:47:13 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:47:13 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:47:13 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:47:13 user nova-compute[75285]:   </os>
Nov 10 21:47:13 user nova-compute[75285]:   <features>
Nov 10 21:47:13 user nova-compute[75285]:     <acpi/>
Nov 10 21:47:13 user nova-compute[75285]:     <apic/>
Nov 10 21:47:13 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:47:13 user nova-compute[75285]:   </features>
Nov 10 21:47:13 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:47:13 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:47:13 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:47:13 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:47:13 user nova-compute[75285]:   </clock>
Nov 10 21:47:13 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:47:13 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:47:13 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:47:13 user nova-compute[75285]:   </cpu>
Nov 10 21:47:13 user nova-compute[75285]:   <devices>
Nov 10 21:47:13 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:47:13 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:47:13 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk"/>
Nov 10 21:47:13 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:47:13 user nova-compute[75285]:     </disk>
Nov 10 21:47:13 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:47:13 user nova-compute[75285]:       <mac address="fa:16:3e:da:79:d6"/>
Nov 10 21:47:13 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:47:13 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:47:13 user nova-compute[75285]:       <target dev="tapbf303f2b-48"/>
Nov 10 21:47:13 user nova-compute[75285]:     </interface>
Nov 10 21:47:13 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:47:13 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/console.log" append="off"/>
Nov 10 21:47:13 user nova-compute[75285]:     </serial>
Nov 10 21:47:13 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:47:13 user nova-compute[75285]:     <video>
Nov 10 21:47:13 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:47:13 user nova-compute[75285]:     </video>
Nov 10 21:47:13 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:47:13 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:47:13 user nova-compute[75285]:     </rng>
Nov 10 21:47:13 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:47:13 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:47:13 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:47:13 user nova-compute[75285]:     </memballoon>
Nov 10 21:47:13 user nova-compute[75285]:   </devices>
Nov 10 21:47:13 user nova-compute[75285]: </domain>
Nov 10 21:47:13 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1664109897',display_name='tempest-TestMinimumBasicScenario-server-1664109897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1664109897',id=48,image_ref='b2824634-ff9e-4ae5-9da6-b66d3f04d1dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuVMYmNRx64Pj7St2vh0O+0SlHGGlAdvL6wrmO53jHjMBiD/xn7M1S7npOfjsPKn1tR47m1uzoKo8UVzlR3nLHkXdGDp3ZuOFtAKQkBjk0u+ctBgPCmISWi1+ZXIlHY0w==',key_name='tempest-TestMinimumBasicScenario-1404195034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5be8bdaa0904649a3942a800ab22520',ramdisk_id='',reservation_id='r-5irnhmq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b2824634-ff9e-4ae5-9da6-b66d3f04d1dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-546154678',owner_user_name='tempest-TestMinimumBasicScenario-546154678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:47:10Z,user_data=None,user_id='face290806c0494b956c6574c086fda8',uuid=db49b877-4758-467f-82a7-7ebc25489972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converting VIF {"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf303f2b-484f-4bb9-8f64-e546ee08ea57,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf303f2b-48') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG os_vif [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf303f2b-484f-4bb9-8f64-e546ee08ea57,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf303f2b-48') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fdf31b9-05f6-5fed-8fc5-ada5fa409760', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf303f2b-48, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf303f2b-48, col_values=(('qos', UUID('e833ed28-5f53-4890-99b0-0cf8d3dc76d2')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf303f2b-48, col_values=(('external_ids', {'iface-id': 'bf303f2b-484f-4bb9-8f64-e546ee08ea57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:79:d6', 'vm-uuid': 'db49b877-4758-467f-82a7-7ebc25489972'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:13 user nova-compute[75285]: INFO os_vif [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf303f2b-484f-4bb9-8f64-e546ee08ea57,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf303f2b-48')
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] No VIF found with MAC fa:16:3e:da:79:d6, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.network.neutron [req-7a0074ff-6442-4154-b4cb-07843ab105d7 req-785c3058-caba-47db-a217-555fc40f7ab6 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updated VIF entry in instance network info cache for port bf303f2b-484f-4bb9-8f64-e546ee08ea57. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG nova.network.neutron [req-7a0074ff-6442-4154-b4cb-07843ab105d7 req-785c3058-caba-47db-a217-555fc40f7ab6 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updating instance_info_cache with network_info: [{"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:47:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7a0074ff-6442-4154-b4cb-07843ab105d7 req-785c3058-caba-47db-a217-555fc40f7ab6 service nova] Releasing lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.network.neutron [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Successfully updated port: 32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquired lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.network.neutron [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.network.neutron [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.network.neutron [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updating instance_info_cache with network_info: [{"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Releasing lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Instance network_info: |[{"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Start _get_guest_xml network_info=[{"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e00023c7-f7f3-49f2-b464-c809b7ab7608'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:47:14 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:47:14 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T20:58:58Z,direct_url=<?>,disk_format='qcow2',id=e00023c7-f7f3-49f2-b464-c809b7ab7608,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='716e3a4182a04b06b7fd231305875438',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T20:58:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1336114405',display_name='tempest-SnapshotDataIntegrityTests-server-1336114405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1336114405',id=49,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoy9QjyuQX+M6Ro2B0S0PjJ8VtpDfUT1wvflgqy0O0Zp71HP0DkeaH46+KZ8qUof6SA1KAhCr5XG+Cgm549brvvmxwwPiXKbM6SsupnQ1p59QY05gwZ6F6/RgBMfvalrA==',key_name='tempest-keypair-428784909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f13cd60442854c50b825af9e6f70d18e',ramdisk_id='',reservation_id='r-vpkhgpbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2111065423',owner_user_name='tempest-SnapshotDataIntegrityTests-2111065423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7785cf2c3a6046cda94bba0bc3d9301d',uuid=4883d7cc-ee48-42d6-aecc-82e68f203441,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Converting VIF {"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9e:1b,bridge_name='br-int',has_traffic_filtering=True,id=32da4b81-4b9a-4ee3-acc5-77ded90023f7,network=Network(d863da2d-c5de-41fc-92e4-a6a6ae46c7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32da4b81-4b') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.objects.instance [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lazy-loading 'pci_devices' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:47:14 user nova-compute[75285]:   <uuid>4883d7cc-ee48-42d6-aecc-82e68f203441</uuid>
Nov 10 21:47:14 user nova-compute[75285]:   <name>instance-00000031</name>
Nov 10 21:47:14 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:47:14 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:47:14 user nova-compute[75285]:   <metadata>
Nov 10 21:47:14 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:47:14 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:47:14 user nova-compute[75285]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1336114405</nova:name>
Nov 10 21:47:14 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:47:14</nova:creationTime>
Nov 10 21:47:14 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:47:14 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:47:14 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:47:14 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:47:14 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:47:14 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:47:14 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:47:14 user nova-compute[75285]:       <nova:owner>
Nov 10 21:47:14 user nova-compute[75285]:         <nova:user uuid="7785cf2c3a6046cda94bba0bc3d9301d">tempest-SnapshotDataIntegrityTests-2111065423-project-member</nova:user>
Nov 10 21:47:14 user nova-compute[75285]:         <nova:project uuid="f13cd60442854c50b825af9e6f70d18e">tempest-SnapshotDataIntegrityTests-2111065423</nova:project>
Nov 10 21:47:14 user nova-compute[75285]:       </nova:owner>
Nov 10 21:47:14 user nova-compute[75285]:       <nova:root type="image" uuid="e00023c7-f7f3-49f2-b464-c809b7ab7608"/>
Nov 10 21:47:14 user nova-compute[75285]:       <nova:ports>
Nov 10 21:47:14 user nova-compute[75285]:         <nova:port uuid="32da4b81-4b9a-4ee3-acc5-77ded90023f7">
Nov 10 21:47:14 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 21:47:14 user nova-compute[75285]:         </nova:port>
Nov 10 21:47:14 user nova-compute[75285]:       </nova:ports>
Nov 10 21:47:14 user nova-compute[75285]:     </nova:instance>
Nov 10 21:47:14 user nova-compute[75285]:   </metadata>
Nov 10 21:47:14 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:47:14 user nova-compute[75285]:     <system>
Nov 10 21:47:14 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:47:14 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:47:14 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:47:14 user nova-compute[75285]:       <entry name="serial">4883d7cc-ee48-42d6-aecc-82e68f203441</entry>
Nov 10 21:47:14 user nova-compute[75285]:       <entry name="uuid">4883d7cc-ee48-42d6-aecc-82e68f203441</entry>
Nov 10 21:47:14 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:47:14 user nova-compute[75285]:     </system>
Nov 10 21:47:14 user nova-compute[75285]:   </sysinfo>
Nov 10 21:47:14 user nova-compute[75285]:   <os>
Nov 10 21:47:14 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:47:14 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:47:14 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:47:14 user nova-compute[75285]:   </os>
Nov 10 21:47:14 user nova-compute[75285]:   <features>
Nov 10 21:47:14 user nova-compute[75285]:     <acpi/>
Nov 10 21:47:14 user nova-compute[75285]:     <apic/>
Nov 10 21:47:14 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:47:14 user nova-compute[75285]:   </features>
Nov 10 21:47:14 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:47:14 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:47:14 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:47:14 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:47:14 user nova-compute[75285]:   </clock>
Nov 10 21:47:14 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:47:14 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:47:14 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:47:14 user nova-compute[75285]:   </cpu>
Nov 10 21:47:14 user nova-compute[75285]:   <devices>
Nov 10 21:47:14 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:47:14 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:47:14 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk"/>
Nov 10 21:47:14 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:47:14 user nova-compute[75285]:     </disk>
Nov 10 21:47:14 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:47:14 user nova-compute[75285]:       <mac address="fa:16:3e:a2:9e:1b"/>
Nov 10 21:47:14 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:47:14 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:47:14 user nova-compute[75285]:       <target dev="tap32da4b81-4b"/>
Nov 10 21:47:14 user nova-compute[75285]:     </interface>
Nov 10 21:47:14 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:47:14 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/console.log" append="off"/>
Nov 10 21:47:14 user nova-compute[75285]:     </serial>
Nov 10 21:47:14 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:47:14 user nova-compute[75285]:     <video>
Nov 10 21:47:14 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:47:14 user nova-compute[75285]:     </video>
Nov 10 21:47:14 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:47:14 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:47:14 user nova-compute[75285]:     </rng>
Nov 10 21:47:14 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:47:14 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:47:14 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:47:14 user nova-compute[75285]:     </memballoon>
Nov 10 21:47:14 user nova-compute[75285]:   </devices>
Nov 10 21:47:14 user nova-compute[75285]: </domain>
Nov 10 21:47:14 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1336114405',display_name='tempest-SnapshotDataIntegrityTests-server-1336114405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1336114405',id=49,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoy9QjyuQX+M6Ro2B0S0PjJ8VtpDfUT1wvflgqy0O0Zp71HP0DkeaH46+KZ8qUof6SA1KAhCr5XG+Cgm549brvvmxwwPiXKbM6SsupnQ1p59QY05gwZ6F6/RgBMfvalrA==',key_name='tempest-keypair-428784909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f13cd60442854c50b825af9e6f70d18e',ramdisk_id='',reservation_id='r-vpkhgpbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2111065423',owner_user_name='tempest-SnapshotDataIntegrityTests-2111065423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7785cf2c3a6046cda94bba0bc3d9301d',uuid=4883d7cc-ee48-42d6-aecc-82e68f203441,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Converting VIF {"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9e:1b,bridge_name='br-int',has_traffic_filtering=True,id=32da4b81-4b9a-4ee3-acc5-77ded90023f7,network=Network(d863da2d-c5de-41fc-92e4-a6a6ae46c7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32da4b81-4b') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG os_vif [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9e:1b,bridge_name='br-int',has_traffic_filtering=True,id=32da4b81-4b9a-4ee3-acc5-77ded90023f7,network=Network(d863da2d-c5de-41fc-92e4-a6a6ae46c7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32da4b81-4b') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: db49b877-4758-467f-82a7-7ebc25489972] Skipping network cache update for instance because it is Building. {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Skipping network cache update for instance because it is Building. {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Didn't find any instances for network info cache update. {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18bd1b4d-55dd-5d22-9797-100bd264369b', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32da4b81-4b, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32da4b81-4b, col_values=(('qos', UUID('305301e1-f7d7-485e-912e-f0c9ccc66304')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32da4b81-4b, col_values=(('external_ids', {'iface-id': '32da4b81-4b9a-4ee3-acc5-77ded90023f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:9e:1b', 'vm-uuid': '4883d7cc-ee48-42d6-aecc-82e68f203441'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:14 user nova-compute[75285]: INFO os_vif [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9e:1b,bridge_name='br-int',has_traffic_filtering=True,id=32da4b81-4b9a-4ee3-acc5-77ded90023f7,network=Network(d863da2d-c5de-41fc-92e4-a6a6ae46c7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32da4b81-4b')
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] No VIF found with MAC fa:16:3e:a2:9e:1b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-0221dff3-30ea-48ed-89a2-518377efa805 req-4f39fcff-53d1-4898-9c0f-4cb95c4a4963 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Received event network-changed-32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.compute.manager [req-0221dff3-30ea-48ed-89a2-518377efa805 req-4f39fcff-53d1-4898-9c0f-4cb95c4a4963 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Refreshing instance network info cache due to event network-changed-32da4b81-4b9a-4ee3-acc5-77ded90023f7. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0221dff3-30ea-48ed-89a2-518377efa805 req-4f39fcff-53d1-4898-9c0f-4cb95c4a4963 service nova] Acquiring lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0221dff3-30ea-48ed-89a2-518377efa805 req-4f39fcff-53d1-4898-9c0f-4cb95c4a4963 service nova] Acquired lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:47:14 user nova-compute[75285]: DEBUG nova.network.neutron [req-0221dff3-30ea-48ed-89a2-518377efa805 req-4f39fcff-53d1-4898-9c0f-4cb95c4a4963 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Refreshing network info cache for port 32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG nova.network.neutron [req-0221dff3-30ea-48ed-89a2-518377efa805 req-4f39fcff-53d1-4898-9c0f-4cb95c4a4963 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updated VIF entry in instance network info cache for port 32da4b81-4b9a-4ee3-acc5-77ded90023f7. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG nova.network.neutron [req-0221dff3-30ea-48ed-89a2-518377efa805 req-4f39fcff-53d1-4898-9c0f-4cb95c4a4963 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updating instance_info_cache with network_info: [{"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0221dff3-30ea-48ed-89a2-518377efa805 req-4f39fcff-53d1-4898-9c0f-4cb95c4a4963 service nova] Releasing lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-4eaa4d71-0253-4b56-9eb2-8fc8c8cafb7f req-cacbf1a9-13fc-4981-b27c-62b8865cbe7a service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4eaa4d71-0253-4b56-9eb2-8fc8c8cafb7f req-cacbf1a9-13fc-4981-b27c-62b8865cbe7a service nova] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4eaa4d71-0253-4b56-9eb2-8fc8c8cafb7f req-cacbf1a9-13fc-4981-b27c-62b8865cbe7a service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-4eaa4d71-0253-4b56-9eb2-8fc8c8cafb7f req-cacbf1a9-13fc-4981-b27c-62b8865cbe7a service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-4eaa4d71-0253-4b56-9eb2-8fc8c8cafb7f req-cacbf1a9-13fc-4981-b27c-62b8865cbe7a service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] No waiting events found dispatching network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:47:15 user nova-compute[75285]: WARNING nova.compute.manager [req-4eaa4d71-0253-4b56-9eb2-8fc8c8cafb7f req-cacbf1a9-13fc-4981-b27c-62b8865cbe7a service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received unexpected event network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 for instance with vm_state building and task_state spawning.
Nov 10 21:47:15 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:16 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:47:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-171c602e-9f8e-4c01-a1f1-d51c25772799 req-31448481-8011-470c-98b5-a5dd852f9076 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Received event network-vif-plugged-32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:47:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-171c602e-9f8e-4c01-a1f1-d51c25772799 req-31448481-8011-470c-98b5-a5dd852f9076 service nova] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-171c602e-9f8e-4c01-a1f1-d51c25772799 req-31448481-8011-470c-98b5-a5dd852f9076 service nova] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-171c602e-9f8e-4c01-a1f1-d51c25772799 req-31448481-8011-470c-98b5-a5dd852f9076 service nova] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:16 user nova-compute[75285]: DEBUG nova.compute.manager [req-171c602e-9f8e-4c01-a1f1-d51c25772799 req-31448481-8011-470c-98b5-a5dd852f9076 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] No waiting events found dispatching network-vif-plugged-32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:47:16 user nova-compute[75285]: WARNING nova.compute.manager [req-171c602e-9f8e-4c01-a1f1-d51c25772799 req-31448481-8011-470c-98b5-a5dd852f9076 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Received unexpected event network-vif-plugged-32da4b81-4b9a-4ee3-acc5-77ded90023f7 for instance with vm_state building and task_state spawning.
Nov 10 21:47:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-c979504f-6dd6-49e2-a79f-d1f602f6ea5c req-e7268ecc-342c-47e4-9704-3ecd56d77b65 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:47:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c979504f-6dd6-49e2-a79f-d1f602f6ea5c req-e7268ecc-342c-47e4-9704-3ecd56d77b65 service nova] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c979504f-6dd6-49e2-a79f-d1f602f6ea5c req-e7268ecc-342c-47e4-9704-3ecd56d77b65 service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c979504f-6dd6-49e2-a79f-d1f602f6ea5c req-e7268ecc-342c-47e4-9704-3ecd56d77b65 service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:17 user nova-compute[75285]: DEBUG nova.compute.manager [req-c979504f-6dd6-49e2-a79f-d1f602f6ea5c req-e7268ecc-342c-47e4-9704-3ecd56d77b65 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] No waiting events found dispatching network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:47:17 user nova-compute[75285]: WARNING nova.compute.manager [req-c979504f-6dd6-49e2-a79f-d1f602f6ea5c req-e7268ecc-342c-47e4-9704-3ecd56d77b65 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received unexpected event network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 for instance with vm_state building and task_state spawning.
Nov 10 21:47:18 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:47:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:47:18 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: db49b877-4758-467f-82a7-7ebc25489972] Instance spawned successfully.
Nov 10 21:47:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:47:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:47:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:47:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:47:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:47:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:47:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:47:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:47:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:47:19 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Instance spawned successfully.
Nov 10 21:47:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:47:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:47:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:47:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:47:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:47:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:47:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:47:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-6e6a4479-947c-4475-b027-fe3b31aee61f req-0319281a-681d-4d48-b9b0-9bd4c4c76c3b service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Received event network-vif-plugged-32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:47:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6e6a4479-947c-4475-b027-fe3b31aee61f req-0319281a-681d-4d48-b9b0-9bd4c4c76c3b service nova] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:47:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6e6a4479-947c-4475-b027-fe3b31aee61f req-0319281a-681d-4d48-b9b0-9bd4c4c76c3b service nova] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:47:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6e6a4479-947c-4475-b027-fe3b31aee61f req-0319281a-681d-4d48-b9b0-9bd4c4c76c3b service nova] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:19 user nova-compute[75285]: DEBUG nova.compute.manager [req-6e6a4479-947c-4475-b027-fe3b31aee61f req-0319281a-681d-4d48-b9b0-9bd4c4c76c3b service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] No waiting events found dispatching network-vif-plugged-32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:47:19 user nova-compute[75285]: WARNING nova.compute.manager [req-6e6a4479-947c-4475-b027-fe3b31aee61f req-0319281a-681d-4d48-b9b0-9bd4c4c76c3b service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Received unexpected event network-vif-plugged-32da4b81-4b9a-4ee3-acc5-77ded90023f7 for instance with vm_state building and task_state spawning.
Nov 10 21:47:19 user nova-compute[75285]: INFO nova.compute.manager [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Took 8.89 seconds to spawn the instance on the hypervisor.
Nov 10 21:47:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:47:19 user nova-compute[75285]: INFO nova.compute.manager [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Took 8.03 seconds to spawn the instance on the hypervisor.
Nov 10 21:47:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:47:19 user nova-compute[75285]: INFO nova.compute.manager [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Took 9.65 seconds to build instance.
Nov 10 21:47:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2a474143-dcbf-478f-bc13-4ae4d5eab924 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "db49b877-4758-467f-82a7-7ebc25489972" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.792s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:19 user nova-compute[75285]: INFO nova.compute.manager [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Took 9.31 seconds to build instance.
Nov 10 21:47:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa4e76b7-2e2a-4274-9509-6efe6755f358 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.421s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:47:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:20 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:47:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:47:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:23 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:47:23 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:47:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:47:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:47:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:47:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:47:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:47:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:48:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:48:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:48:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:48:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:48:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:48:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:48:05 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:48:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:48:11 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:48:12 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:48:13 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:48:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:48:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:48:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:48:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:48:13 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: db49b877-4758-467f-82a7-7ebc25489972] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:48:13 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updating instance_info_cache with network_info: [{"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:48:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:48:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:48:15 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:48:15 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:48:15 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=24.889068603515625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:48:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:48:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:48:15 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance db49b877-4758-467f-82a7-7ebc25489972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:48:15 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 4883d7cc-ee48-42d6-aecc-82e68f203441 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:48:15 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:48:15 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:48:15 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:48:15 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:48:15 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:48:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:48:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:48:19 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:48:19 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:48:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:48:22 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:48:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:48:23 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:48:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:48:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:48:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:48:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:48:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:48:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:48:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:48:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:48:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:48:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:48:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:48:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:48:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:48:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:48:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:48:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:48:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:48:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:49:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-251b37c5-c2ea-4482-8df8-75bf35c66ed8 req-98735dab-e292-4809-bcda-6738266f1311 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Received event network-changed-32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:49:00 user nova-compute[75285]: DEBUG nova.compute.manager [req-251b37c5-c2ea-4482-8df8-75bf35c66ed8 req-98735dab-e292-4809-bcda-6738266f1311 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Refreshing instance network info cache due to event network-changed-32da4b81-4b9a-4ee3-acc5-77ded90023f7. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:49:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-251b37c5-c2ea-4482-8df8-75bf35c66ed8 req-98735dab-e292-4809-bcda-6738266f1311 service nova] Acquiring lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:49:00 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-251b37c5-c2ea-4482-8df8-75bf35c66ed8 req-98735dab-e292-4809-bcda-6738266f1311 service nova] Acquired lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:49:00 user nova-compute[75285]: DEBUG nova.network.neutron [req-251b37c5-c2ea-4482-8df8-75bf35c66ed8 req-98735dab-e292-4809-bcda-6738266f1311 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Refreshing network info cache for port 32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:49:01 user nova-compute[75285]: DEBUG nova.network.neutron [req-251b37c5-c2ea-4482-8df8-75bf35c66ed8 req-98735dab-e292-4809-bcda-6738266f1311 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updated VIF entry in instance network info cache for port 32da4b81-4b9a-4ee3-acc5-77ded90023f7. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:49:01 user nova-compute[75285]: DEBUG nova.network.neutron [req-251b37c5-c2ea-4482-8df8-75bf35c66ed8 req-98735dab-e292-4809-bcda-6738266f1311 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updating instance_info_cache with network_info: [{"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:49:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-251b37c5-c2ea-4482-8df8-75bf35c66ed8 req-98735dab-e292-4809-bcda-6738266f1311 service nova] Releasing lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:49:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:49:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "db49b877-4758-467f-82a7-7ebc25489972" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:49:05 user nova-compute[75285]: DEBUG nova.objects.instance [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'flavor' on Instance uuid db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:49:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "db49b877-4758-467f-82a7-7ebc25489972" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "db49b877-4758-467f-82a7-7ebc25489972" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:49:06 user nova-compute[75285]: INFO nova.compute.manager [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Attaching volume 8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 to /dev/vdb
Nov 10 21:49:06 user nova-compute[75285]: DEBUG os_brick.utils [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c76a17-93f9-4376-ad04-e904b6a43c6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab27af6-df68-47d5-8493-bb2320d90f26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[883167cb-72fc-45ef-bed8-579fa8c3f33b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[770f1420-85d0-4949-94c3-eaab5709188d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:49:06 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:49:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd98f27-17af-4997-98e7-92b20f130baa]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG os_brick.utils [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:49:06 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updating existing volume attachment record: 6c5cf677-c290-46a5-9807-b0db74836789 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:49:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:07 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:49:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:49:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:49:07 user nova-compute[75285]: DEBUG nova.objects.instance [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lazy-loading 'flavor' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:49:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:49:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:49:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:49:07 user nova-compute[75285]: INFO nova.compute.manager [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Attaching volume 883d94f1-62f2-46ba-8747-e4cd5d673fc0 to /dev/vdb
Nov 10 21:49:07 user nova-compute[75285]: DEBUG os_brick.utils [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:49:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:07 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[22003305-fbcc-43c1-93e0-07b27d242c30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:07 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[35da98b2-59e5-407d-ac78-deb9f660a27f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[53eafb60-363b-486b-8140-99a4d9896f81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce52200e-fcf4-4cf5-9f46-168d8512bb5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:49:08 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:49:08 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[806018db-58d5-413c-9e98-89208d374af2]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG os_brick.utils [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:49:08 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updating existing volume attachment record: 8c0f9db8-ceec-4338-ac30-28b1fd006658 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:49:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:11 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:49:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:13 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:49:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:49:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:49:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:49:13 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:49:14 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updating instance_info_cache with network_info: [{"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:49:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:49:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:49:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:49:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:49:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:49:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:49:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:49:14 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:49:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:15 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:15 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:49:15 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:49:15 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8887MB free_disk=24.880054473876953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:49:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:49:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance db49b877-4758-467f-82a7-7ebc25489972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 4883d7cc-ee48-42d6-aecc-82e68f203441 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing inventories for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating ProviderTree inventory for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating inventory in ProviderTree for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing aggregate associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, aggregates: None {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing trait associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 21:49:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] There are 0 instances to clean {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 21:49:17 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:21 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:49:21 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:49:23 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:49:24 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:49:24 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:49:24 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:49:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:49:25 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_power_states {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:49:25 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:49:25 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Triggering sync for uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 21:49:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:49:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGIMuKVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:49:29 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:49:29 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:49:29 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[596296c6-d725-49b0-b263-52f1aa9da623]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:49:29 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9baf01a7-d4bb-4943-8f9c-7a729b2ebdad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8] added
Nov 10 21:49:29 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e657f9-9426-4e1d-8b14-207bf0b4e427]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f332eb05-b764-472b-b25e-e89528c9a3b8]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGIMuKVT {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGIMuKVT" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9cb425-eff0-4193-9a70-2235c234752f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aGIMuKVT'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.146s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a790474c-8f2f-4702-a37c-2c36e1fc087d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[25318318-59d3-4ae2-886e-828353dc14f8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:49:29 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:49:29 user nova-compute[75285]:  {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:49:29 user nova-compute[75285]: WARNING os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 21:49:29 user nova-compute[75285]: 
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fafd3d-c258-48d9-bc0c-5b8aa42eb6f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260]
Nov 10 21:49:29 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260] successful.
Nov 10 21:49:29 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33a8ed8-88f1-4c14-87d8-4e47ad006ee1]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:29 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:30 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8b009b-4cfb-4922-b5b0-dbf0144cd086]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:49:30 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:49:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:49:30 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:49:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:49:30 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:49:30 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:49:30 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:49:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:30 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:30 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f62e83c-f99e-41ad-9763-3d3e78d786c1]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:30 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGIMuKVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26262653330316562', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262653330316562', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG nova.objects.instance [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'flavor' on Instance uuid db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:49:31 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:49:31 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:49:31 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:49:31 user nova-compute[75285]:   <serial>8bbeacab-9ed7-4dea-9d3c-01e9092fafd8</serial>
Nov 10 21:49:31 user nova-compute[75285]: </disk>
Nov 10 21:49:31 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] No VIF found with MAC fa:16:3e:da:79:d6, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-46453c3e-0ca0-42a5-bcde-03649c1abe7e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "db49b877-4758-467f-82a7-7ebc25489972" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.608s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "db49b877-4758-467f-82a7-7ebc25489972" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.880s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "db49b877-4758-467f-82a7-7ebc25489972" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIyodLKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:49:31 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:49:31 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:49:31 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab540db-f135-4e24-aeda-f867b43d24ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:49:31 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[371dd084-fd27-4383-8708-24c97193edfd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0] added
Nov 10 21:49:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb3e4c0-fa81-4386-a94a-d5c12a903402]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14689f4-a5ed-4491-bf0c-58675ebf7f53]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jIyodLKM {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jIyodLKM" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9cf416-1bb3-45c2-8938-af362655faa1]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jIyodLKM'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dce588d-cf15-4d6f-815a-53574abc23fb]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a94b7ed-e5f8-44fd-9781-9bc5ce673351]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:49:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:49:31 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:49:31 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1443e528-317f-479c-bba5-510841acd10d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0, portal: 172.16.0.220,3260]
Nov 10 21:49:32 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0, portal: 172.16.0.220,3260] successful.
Nov 10 21:49:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[590c9e73-8ffa-4e99-aca8-cd49cf6ded3d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaa0e89-4589-4b9d-9a88-b51dd67e0b4e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:49:32 user nova-compute[75285]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)
Nov 10 21:49:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:49:32 user nova-compute[75285]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)
Nov 10 21:49:32 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[241f1d0a-7494-41e7-87b1-190ad9bedd7e]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIyodLKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:49:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:49:33 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26163373264633437', 'path': '/dev/sdc'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:49:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163373264633437', 'path': '/dev/sdc'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:49:33 user nova-compute[75285]: DEBUG nova.objects.instance [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lazy-loading 'flavor' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:49:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:49:33 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:49:33 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:49:33 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:49:33 user nova-compute[75285]:   <serial>883d94f1-62f2-46ba-8747-e4cd5d673fc0</serial>
Nov 10 21:49:33 user nova-compute[75285]: </disk>
Nov 10 21:49:33 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:49:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:49:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:49:33 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] No VIF found with MAC fa:16:3e:a2:9e:1b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:49:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-aa2e02b3-0a12-4790-b157-68e4b65b46c9 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.733s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:49:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.879s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:49:33 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:49:34 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:49:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:39 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:49:39 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances with incomplete migration  {{(pid=75285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 21:49:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:49:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-285448ea-fb81-4d5c-a6a0-7ee9eccbeaa1 req-db8cbae2-3f4b-4f55-9f9e-a69198162f2c service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-changed-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:49:46 user nova-compute[75285]: DEBUG nova.compute.manager [req-285448ea-fb81-4d5c-a6a0-7ee9eccbeaa1 req-db8cbae2-3f4b-4f55-9f9e-a69198162f2c service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Refreshing instance network info cache due to event network-changed-bf303f2b-484f-4bb9-8f64-e546ee08ea57. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:49:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-285448ea-fb81-4d5c-a6a0-7ee9eccbeaa1 req-db8cbae2-3f4b-4f55-9f9e-a69198162f2c service nova] Acquiring lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:49:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-285448ea-fb81-4d5c-a6a0-7ee9eccbeaa1 req-db8cbae2-3f4b-4f55-9f9e-a69198162f2c service nova] Acquired lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:49:46 user nova-compute[75285]: DEBUG nova.network.neutron [req-285448ea-fb81-4d5c-a6a0-7ee9eccbeaa1 req-db8cbae2-3f4b-4f55-9f9e-a69198162f2c service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Refreshing network info cache for port bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:49:47 user nova-compute[75285]: DEBUG nova.network.neutron [req-285448ea-fb81-4d5c-a6a0-7ee9eccbeaa1 req-db8cbae2-3f4b-4f55-9f9e-a69198162f2c service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updated VIF entry in instance network info cache for port bf303f2b-484f-4bb9-8f64-e546ee08ea57. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:49:47 user nova-compute[75285]: DEBUG nova.network.neutron [req-285448ea-fb81-4d5c-a6a0-7ee9eccbeaa1 req-db8cbae2-3f4b-4f55-9f9e-a69198162f2c service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updating instance_info_cache with network_info: [{"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:49:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-285448ea-fb81-4d5c-a6a0-7ee9eccbeaa1 req-db8cbae2-3f4b-4f55-9f9e-a69198162f2c service nova] Releasing lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:49:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:49 user nova-compute[75285]: DEBUG nova.compute.manager [req-2150d055-b558-496c-a2bc-60e142feead0 req-6cca6cba-0d55-4d52-96ed-2b3bc0f5cf2a service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-changed-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:49:49 user nova-compute[75285]: DEBUG nova.compute.manager [req-2150d055-b558-496c-a2bc-60e142feead0 req-6cca6cba-0d55-4d52-96ed-2b3bc0f5cf2a service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Refreshing instance network info cache due to event network-changed-bf303f2b-484f-4bb9-8f64-e546ee08ea57. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:49:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2150d055-b558-496c-a2bc-60e142feead0 req-6cca6cba-0d55-4d52-96ed-2b3bc0f5cf2a service nova] Acquiring lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:49:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2150d055-b558-496c-a2bc-60e142feead0 req-6cca6cba-0d55-4d52-96ed-2b3bc0f5cf2a service nova] Acquired lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:49:49 user nova-compute[75285]: DEBUG nova.network.neutron [req-2150d055-b558-496c-a2bc-60e142feead0 req-6cca6cba-0d55-4d52-96ed-2b3bc0f5cf2a service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Refreshing network info cache for port bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:49:49 user nova-compute[75285]: DEBUG nova.network.neutron [req-2150d055-b558-496c-a2bc-60e142feead0 req-6cca6cba-0d55-4d52-96ed-2b3bc0f5cf2a service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updated VIF entry in instance network info cache for port bf303f2b-484f-4bb9-8f64-e546ee08ea57. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:49:49 user nova-compute[75285]: DEBUG nova.network.neutron [req-2150d055-b558-496c-a2bc-60e142feead0 req-6cca6cba-0d55-4d52-96ed-2b3bc0f5cf2a service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updating instance_info_cache with network_info: [{"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:49:49 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-2150d055-b558-496c-a2bc-60e142feead0 req-6cca6cba-0d55-4d52-96ed-2b3bc0f5cf2a service nova] Releasing lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:49:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:49:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:50:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:12 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:50:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:50:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "db49b877-4758-467f-82a7-7ebc25489972" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:50:12 user nova-compute[75285]: INFO nova.compute.manager [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Rebooting instance
Nov 10 21:50:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:50:12 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquired lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:50:12 user nova-compute[75285]: DEBUG nova.network.neutron [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG nova.network.neutron [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updating instance_info_cache with network_info: [{"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Releasing lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: db49b877-4758-467f-82a7-7ebc25489972] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-51dd5cda-40c7-4ea4-a02c-3606025202eb req-1fcaf7ae-1dbf-4ee9-bbf3-ed4b9971fb6b service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-vif-unplugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-51dd5cda-40c7-4ea4-a02c-3606025202eb req-1fcaf7ae-1dbf-4ee9-bbf3-ed4b9971fb6b service nova] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-51dd5cda-40c7-4ea4-a02c-3606025202eb req-1fcaf7ae-1dbf-4ee9-bbf3-ed4b9971fb6b service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-51dd5cda-40c7-4ea4-a02c-3606025202eb req-1fcaf7ae-1dbf-4ee9-bbf3-ed4b9971fb6b service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:50:13 user nova-compute[75285]: DEBUG nova.compute.manager [req-51dd5cda-40c7-4ea4-a02c-3606025202eb req-1fcaf7ae-1dbf-4ee9-bbf3-ed4b9971fb6b service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] No waiting events found dispatching network-vif-unplugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:50:13 user nova-compute[75285]: WARNING nova.compute.manager [req-51dd5cda-40c7-4ea4-a02c-3606025202eb req-1fcaf7ae-1dbf-4ee9-bbf3-ed4b9971fb6b service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received unexpected event network-vif-unplugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updating instance_info_cache with network_info: [{"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:14 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: db49b877-4758-467f-82a7-7ebc25489972] Instance destroyed successfully.
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'resources' on Instance uuid db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1664109897',display_name='tempest-TestMinimumBasicScenario-server-1664109897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1664109897',id=48,image_ref='b2824634-ff9e-4ae5-9da6-b66d3f04d1dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuVMYmNRx64Pj7St2vh0O+0SlHGGlAdvL6wrmO53jHjMBiD/xn7M1S7npOfjsPKn1tR47m1uzoKo8UVzlR3nLHkXdGDp3ZuOFtAKQkBjk0u+ctBgPCmISWi1+ZXIlHY0w==',key_name='tempest-TestMinimumBasicScenario-1404195034',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:47:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5be8bdaa0904649a3942a800ab22520',ramdisk_id='',reservation_id='r-5irnhmq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b2824634-ff9e-4ae5-9da6-b66d3f04d1dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546154678',owner_user_name='tempest-TestMinimumBasicScenario-546154678-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:50:13Z,user_data=None,user_id='face290806c0494b956c6574c086fda8',uuid=db49b877-4758-467f-82a7-7ebc25489972,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converting VIF {"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf303f2b-484f-4bb9-8f64-e546ee08ea57,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf303f2b-48') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_vif [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf303f2b-484f-4bb9-8f64-e546ee08ea57,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf303f2b-48') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf303f2b-48, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e833ed28-5f53-4890-99b0-0cf8d3dc76d2) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:50:14 user nova-compute[75285]: INFO os_vif [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf303f2b-484f-4bb9-8f64-e546ee08ea57,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf303f2b-48')
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGIMuKVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:50:14 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7613844d-2593-4dcb-97c0-c54ae44ba7c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:50:14 user nova-compute[75285]: No targets found.
Nov 10 21:50:14 user nova-compute[75285]: iSNS:
Nov 10 21:50:14 user nova-compute[75285]: No targets found.
Nov 10 21:50:14 user nova-compute[75285]: STATIC:
Nov 10 21:50:14 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0
Nov 10 21:50:14 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:50:14 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:50:14 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8
Nov 10 21:50:14 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:50:14 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:50:14 user nova-compute[75285]: FIRMWARE:
Nov 10 21:50:14 user nova-compute[75285]: No targets found.
Nov 10 21:50:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:50:14 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:50:14 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac3a979-4c9b-4c10-90d9-5a933570c31b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb1b790-52ec-4bf4-9942-d70959109b0c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:50:14 user nova-compute[75285]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)
Nov 10 21:50:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:50:14 user nova-compute[75285]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)
Nov 10 21:50:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49fc33c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9639b3-53d1-456f-b8bb-ac25a3646f38]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a8aa0f-343d-48f7-9fb4-0b2f57ef647f]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f57104-9f71-44b0-a9a8-2d09be2cc6e6]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9ac47a-05e0-47b7-bb5b-fe1c8ae664ec]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[548bfeb5-104b-44b9-ae54-005b247a26e6]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaf841b-93de-4151-85b2-d4ed018ef585]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260]
Nov 10 21:50:14 user nova-compute[75285]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260] successful.
Nov 10 21:50:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9603b6d2-c4e5-4e2d-b71e-9a230367e191]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] <== disconnect_volume: return (284ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Start _get_guest_xml network_info=[{"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b2824634-ff9e-4ae5-9da6-b66d3f04d1dc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b2824634-ff9e-4ae5-9da6-b66d3f04d1dc'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '6c5cf677-c290-46a5-9807-b0db74836789', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGIMuKVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'db49b877-4758-467f-82a7-7ebc25489972', 'attached_at': '', 'detached_at': '', 'volume_id': '8bbeacab-9ed7-4dea-9d3c-01e9092fafd8', 'serial': '8bbeacab-9ed7-4dea-9d3c-01e9092fafd8'}, 'volume_type': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:50:14 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:50:14 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b2824634-ff9e-4ae5-9da6-b66d3f04d1dc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'vcpu_model' on Instance uuid db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.objects.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Object Instance<db49b877-4758-467f-82a7-7ebc25489972> lazy-loaded attributes: resources,vcpu_model {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGIMuKVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:50:14 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:50:14 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:50:14 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8c4dd2-4c95-49ac-9d89-254d1dea172e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:50:14 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1d0589-51f8-4186-80dd-b3eee0a1e1da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8] added
Nov 10 21:50:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8221aeb-bbdb-4afb-9807-2a8b1a101541]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aa38ec-a20f-4089-8048-9f349204f3c8]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGIMuKVT {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGIMuKVT" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac4920c-4412-4b27-9652-58dbc72746d2]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aGIMuKVT'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3532ee-836b-460f-83b1-644eb324af1e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[720bb06b-36cf-4c21-90e9-a4185db824bf]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)
Nov 10 21:50:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)
Nov 10 21:50:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f13b2a4-2b3f-451b-81ab-44ebffdc2f86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260]
Nov 10 21:50:14 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260] successful.
Nov 10 21:50:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cffe90a-638f-4086-8be7-f001169c712f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f43e9e-a45e-45ea-bdf3-850dbe7b03a9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)
Nov 10 21:50:14 user nova-compute[75285]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:50:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)
Nov 10 21:50:14 user nova-compute[75285]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:50:14 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5313300e-be14-4b4e-880a-7d10614327c8]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:14 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:50:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-658751d2-fcb6-47db-981e-6529b38ed0a8 req-93304286-fb74-459c-95b2-23af4545c7f7 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:50:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-658751d2-fcb6-47db-981e-6529b38ed0a8 req-93304286-fb74-459c-95b2-23af4545c7f7 service nova] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:50:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-658751d2-fcb6-47db-981e-6529b38ed0a8 req-93304286-fb74-459c-95b2-23af4545c7f7 service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:50:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-658751d2-fcb6-47db-981e-6529b38ed0a8 req-93304286-fb74-459c-95b2-23af4545c7f7 service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:50:15 user nova-compute[75285]: DEBUG nova.compute.manager [req-658751d2-fcb6-47db-981e-6529b38ed0a8 req-93304286-fb74-459c-95b2-23af4545c7f7 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] No waiting events found dispatching network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:50:15 user nova-compute[75285]: WARNING nova.compute.manager [req-658751d2-fcb6-47db-981e-6529b38ed0a8 req-93304286-fb74-459c-95b2-23af4545c7f7 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received unexpected event network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 21:50:15 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:50:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGIMuKVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:50:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:50:15 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '26262653330316562', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:50:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262653330316562', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:50:15 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1664109897',display_name='tempest-TestMinimumBasicScenario-server-1664109897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1664109897',id=48,image_ref='b2824634-ff9e-4ae5-9da6-b66d3f04d1dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuVMYmNRx64Pj7St2vh0O+0SlHGGlAdvL6wrmO53jHjMBiD/xn7M1S7npOfjsPKn1tR47m1uzoKo8UVzlR3nLHkXdGDp3ZuOFtAKQkBjk0u+ctBgPCmISWi1+ZXIlHY0w==',key_name='tempest-TestMinimumBasicScenario-1404195034',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:47:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5be8bdaa0904649a3942a800ab22520',ramdisk_id='',reservation_id='r-5irnhmq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b2824634-ff9e-4ae5-9da6-b66d3f04d1dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546154678',owner_user_name='tempest-TestMinimumBasicScenario-546154678-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:50:13Z,user_data=None,user_id='face290806c0494b956c6574c086fda8',uuid=db49b877-4758-467f-82a7-7ebc25489972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:50:15 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converting VIF {"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:50:15 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf303f2b-484f-4bb9-8f64-e546ee08ea57,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf303f2b-48') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:50:15 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'pci_devices' on Instance uuid db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG nova.objects.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Object Instance<db49b877-4758-467f-82a7-7ebc25489972> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:50:16 user nova-compute[75285]:   <uuid>db49b877-4758-467f-82a7-7ebc25489972</uuid>
Nov 10 21:50:16 user nova-compute[75285]:   <name>instance-00000030</name>
Nov 10 21:50:16 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:50:16 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:50:16 user nova-compute[75285]:   <metadata>
Nov 10 21:50:16 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:50:16 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:50:16 user nova-compute[75285]:       <nova:name>tempest-TestMinimumBasicScenario-server-1664109897</nova:name>
Nov 10 21:50:16 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:50:14</nova:creationTime>
Nov 10 21:50:16 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:50:16 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:50:16 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:50:16 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:50:16 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:50:16 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:50:16 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:50:16 user nova-compute[75285]:       <nova:owner>
Nov 10 21:50:16 user nova-compute[75285]:         <nova:user uuid="face290806c0494b956c6574c086fda8">tempest-TestMinimumBasicScenario-546154678-project-member</nova:user>
Nov 10 21:50:16 user nova-compute[75285]:         <nova:project uuid="c5be8bdaa0904649a3942a800ab22520">tempest-TestMinimumBasicScenario-546154678</nova:project>
Nov 10 21:50:16 user nova-compute[75285]:       </nova:owner>
Nov 10 21:50:16 user nova-compute[75285]:       <nova:root type="image" uuid="b2824634-ff9e-4ae5-9da6-b66d3f04d1dc"/>
Nov 10 21:50:16 user nova-compute[75285]:       <nova:ports>
Nov 10 21:50:16 user nova-compute[75285]:         <nova:port uuid="bf303f2b-484f-4bb9-8f64-e546ee08ea57">
Nov 10 21:50:16 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 21:50:16 user nova-compute[75285]:         </nova:port>
Nov 10 21:50:16 user nova-compute[75285]:       </nova:ports>
Nov 10 21:50:16 user nova-compute[75285]:     </nova:instance>
Nov 10 21:50:16 user nova-compute[75285]:   </metadata>
Nov 10 21:50:16 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:50:16 user nova-compute[75285]:     <system>
Nov 10 21:50:16 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:50:16 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:50:16 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:50:16 user nova-compute[75285]:       <entry name="serial">db49b877-4758-467f-82a7-7ebc25489972</entry>
Nov 10 21:50:16 user nova-compute[75285]:       <entry name="uuid">db49b877-4758-467f-82a7-7ebc25489972</entry>
Nov 10 21:50:16 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:50:16 user nova-compute[75285]:     </system>
Nov 10 21:50:16 user nova-compute[75285]:   </sysinfo>
Nov 10 21:50:16 user nova-compute[75285]:   <os>
Nov 10 21:50:16 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:50:16 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:50:16 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:50:16 user nova-compute[75285]:   </os>
Nov 10 21:50:16 user nova-compute[75285]:   <features>
Nov 10 21:50:16 user nova-compute[75285]:     <acpi/>
Nov 10 21:50:16 user nova-compute[75285]:     <apic/>
Nov 10 21:50:16 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:50:16 user nova-compute[75285]:   </features>
Nov 10 21:50:16 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:50:16 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:50:16 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:50:16 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:50:16 user nova-compute[75285]:   </clock>
Nov 10 21:50:16 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:50:16 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:50:16 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:50:16 user nova-compute[75285]:   </cpu>
Nov 10 21:50:16 user nova-compute[75285]:   <devices>
Nov 10 21:50:16 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:50:16 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:50:16 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk"/>
Nov 10 21:50:16 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:50:16 user nova-compute[75285]:     </disk>
Nov 10 21:50:16 user nova-compute[75285]:     <disk type="block" device="disk">
Nov 10 21:50:16 user nova-compute[75285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:50:16 user nova-compute[75285]:       <source dev="/dev/sdb"/>
Nov 10 21:50:16 user nova-compute[75285]:       <target dev="vdb" bus="virtio"/>
Nov 10 21:50:16 user nova-compute[75285]:       <serial>8bbeacab-9ed7-4dea-9d3c-01e9092fafd8</serial>
Nov 10 21:50:16 user nova-compute[75285]:     </disk>
Nov 10 21:50:16 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:50:16 user nova-compute[75285]:       <mac address="fa:16:3e:da:79:d6"/>
Nov 10 21:50:16 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:50:16 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:50:16 user nova-compute[75285]:       <target dev="tapbf303f2b-48"/>
Nov 10 21:50:16 user nova-compute[75285]:     </interface>
Nov 10 21:50:16 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:50:16 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/console.log" append="off"/>
Nov 10 21:50:16 user nova-compute[75285]:     </serial>
Nov 10 21:50:16 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:50:16 user nova-compute[75285]:     <video>
Nov 10 21:50:16 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:50:16 user nova-compute[75285]:     </video>
Nov 10 21:50:16 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:50:16 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:50:16 user nova-compute[75285]:     </rng>
Nov 10 21:50:16 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:50:16 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:50:16 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:50:16 user nova-compute[75285]:     </memballoon>
Nov 10 21:50:16 user nova-compute[75285]:   </devices>
Nov 10 21:50:16 user nova-compute[75285]: </domain>
Nov 10 21:50:16 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'trusted_certs' on Instance uuid db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG nova.objects.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Object Instance<db49b877-4758-467f-82a7-7ebc25489972> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3be78df82ffbc6a53d4ff719d33811a1237f2f72 --force-share --output=json" returned: 0 in 0.188s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Cannot resize image /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG nova.objects.instance [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'migration_context' on Instance uuid db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG nova.objects.base [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Object Instance<db49b877-4758-467f-82a7-7ebc25489972> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75285) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1664109897',display_name='tempest-TestMinimumBasicScenario-server-1664109897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1664109897',id=48,image_ref='b2824634-ff9e-4ae5-9da6-b66d3f04d1dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuVMYmNRx64Pj7St2vh0O+0SlHGGlAdvL6wrmO53jHjMBiD/xn7M1S7npOfjsPKn1tR47m1uzoKo8UVzlR3nLHkXdGDp3ZuOFtAKQkBjk0u+ctBgPCmISWi1+ZXIlHY0w==',key_name='tempest-TestMinimumBasicScenario-1404195034',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:47:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='c5be8bdaa0904649a3942a800ab22520',ramdisk_id='',reservation_id='r-5irnhmq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b2824634-ff9e-4ae5-9da6-b66d3f04d1dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546154678',owner_user_name='tempest-TestMinimumBasicScenario-546154678-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:50:13Z,user_data=None,user_id='face290806c0494b956c6574c086fda8',uuid=db49b877-4758-467f-82a7-7ebc25489972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converting VIF {"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf303f2b-484f-4bb9-8f64-e546ee08ea57,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf303f2b-48') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG os_vif [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf303f2b-484f-4bb9-8f64-e546ee08ea57,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf303f2b-48') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fdf31b9-05f6-5fed-8fc5-ada5fa409760', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf303f2b-48, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf303f2b-48, col_values=(('qos', UUID('91b14ad6-2dbc-4e23-8b17-e3e549db77f2')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf303f2b-48, col_values=(('external_ids', {'iface-id': 'bf303f2b-484f-4bb9-8f64-e546ee08ea57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:79:d6', 'vm-uuid': 'db49b877-4758-467f-82a7-7ebc25489972'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:16 user nova-compute[75285]: INFO os_vif [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf303f2b-484f-4bb9-8f64-e546ee08ea57,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf303f2b-48')
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:16 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:17 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:17 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG nova.compute.manager [req-50ee5e7c-eeb0-4e4d-9af7-e720b5e96027 req-f91e87e4-6b64-4e73-ad02-ee2a23c4f91b service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-50ee5e7c-eeb0-4e4d-9af7-e720b5e96027 req-f91e87e4-6b64-4e73-ad02-ee2a23c4f91b service nova] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-50ee5e7c-eeb0-4e4d-9af7-e720b5e96027 req-f91e87e4-6b64-4e73-ad02-ee2a23c4f91b service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-50ee5e7c-eeb0-4e4d-9af7-e720b5e96027 req-f91e87e4-6b64-4e73-ad02-ee2a23c4f91b service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG nova.compute.manager [req-50ee5e7c-eeb0-4e4d-9af7-e720b5e96027 req-f91e87e4-6b64-4e73-ad02-ee2a23c4f91b service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] No waiting events found dispatching network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:50:20 user nova-compute[75285]: WARNING nova.compute.manager [req-50ee5e7c-eeb0-4e4d-9af7-e720b5e96027 req-f91e87e4-6b64-4e73-ad02-ee2a23c4f91b service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received unexpected event network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 21:50:20 user nova-compute[75285]: DEBUG nova.compute.manager [req-99db2961-2920-4c1f-8e6b-9018d0708136 req-4661c274-822c-4fbc-b989-a713f1c4eddc service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-99db2961-2920-4c1f-8e6b-9018d0708136 req-4661c274-822c-4fbc-b989-a713f1c4eddc service nova] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-99db2961-2920-4c1f-8e6b-9018d0708136 req-4661c274-822c-4fbc-b989-a713f1c4eddc service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-99db2961-2920-4c1f-8e6b-9018d0708136 req-4661c274-822c-4fbc-b989-a713f1c4eddc service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG nova.compute.manager [req-99db2961-2920-4c1f-8e6b-9018d0708136 req-4661c274-822c-4fbc-b989-a713f1c4eddc service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] No waiting events found dispatching network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:50:20 user nova-compute[75285]: WARNING nova.compute.manager [req-99db2961-2920-4c1f-8e6b-9018d0708136 req-4661c274-822c-4fbc-b989-a713f1c4eddc service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received unexpected event network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 21:50:20 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:50:20 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:50:20 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=24.877803802490234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:50:20 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: db49b877-4758-467f-82a7-7ebc25489972] Instance rebooted successfully.
Nov 10 21:50:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-3b2fe651-45f2-4d57-b455-d40007defb5b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "db49b877-4758-467f-82a7-7ebc25489972" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.720s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance db49b877-4758-467f-82a7-7ebc25489972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 4883d7cc-ee48-42d6-aecc-82e68f203441 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:50:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:50:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:23 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:50:23 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:50:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:50:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:50:23 user nova-compute[75285]: INFO nova.compute.manager [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Detaching volume 883d94f1-62f2-46ba-8747-e4cd5d673fc0
Nov 10 21:50:24 user nova-compute[75285]: INFO nova.virt.block_device [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Attempting to driver detach volume 883d94f1-62f2-46ba-8747-e4cd5d673fc0 from mountpoint /dev/vdb
Nov 10 21:50:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Attempting to detach device vdb from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:50:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:50:24 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:50:24 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:50:24 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:50:24 user nova-compute[75285]:   <serial>883d94f1-62f2-46ba-8747-e4cd5d673fc0</serial>
Nov 10 21:50:24 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:50:24 user nova-compute[75285]: </disk>
Nov 10 21:50:24 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:50:24 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Successfully detached device vdb from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the persistent domain config.
Nov 10 21:50:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:50:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:50:24 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:50:24 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:50:24 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:50:24 user nova-compute[75285]:   <serial>883d94f1-62f2-46ba-8747-e4cd5d673fc0</serial>
Nov 10 21:50:24 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:50:24 user nova-compute[75285]: </disk>
Nov 10 21:50:24 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:50:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:50:24 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:50:24 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:50:26 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:50:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:50:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:44 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 is timed out.
Nov 10 21:50:44 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Successfully detached device vdb from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the live domain config.
Nov 10 21:50:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIyodLKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:50:44 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0a05e4-14b1-4d29-b6e2-520d913f891b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:50:44 user nova-compute[75285]: No targets found.
Nov 10 21:50:44 user nova-compute[75285]: iSNS:
Nov 10 21:50:44 user nova-compute[75285]: No targets found.
Nov 10 21:50:44 user nova-compute[75285]: STATIC:
Nov 10 21:50:44 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0
Nov 10 21:50:44 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:50:44 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:50:44 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8
Nov 10 21:50:44 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:50:44 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:50:44 user nova-compute[75285]: FIRMWARE:
Nov 10 21:50:44 user nova-compute[75285]: No targets found.
Nov 10 21:50:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:50:44 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:50:44 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db5a5b8-1943-4f9d-a67c-d69460abc5a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[864512cd-e15e-4ec9-84bd-3b6623d2bc53]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)
Nov 10 21:50:44 user nova-compute[75285]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:50:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 (non-flash)
Nov 10 21:50:44 user nova-compute[75285]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:50:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e4341e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0'): ({'sdc'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Removing single pathed devices sdc {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[51be29ec-2238-4a36-8a24-cef819f4ecfd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[429b0b72-6cd0-4319-aff5-d6fac32071fd]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Flushing IO for device /dev/sdc {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa053c5-13a6-4aea-a6c4-b20e1b341b91]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8488a698-630c-42e8-a391-97e7683293fc]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[95438e83-aaa6-4b48-b7ee-bfee72c8edda]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e54a256-e168-4328-a318-43679904d61b]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0, portal: 172.16.0.220,3260]
Nov 10 21:50:44 user nova-compute[75285]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0, portal: 172.16.0.220,3260] successful.
Nov 10 21:50:44 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883d94f1-62f2-46ba-8747-e4cd5d673fc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e5e39d-72e8-4b19-b3b3-f9d2041fd65f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] <== disconnect_volume: return (287ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:50:44 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:50:45 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lazy-loading 'flavor' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:50:45 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2378d88a-be37-4464-ba9b-b23a56900d06 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.873s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:50:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:50:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:51:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:51:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:51:10 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:51:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:51:12 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:51:15 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:51:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:51:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:51:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:51:15 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:51:16 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updating instance_info_cache with network_info: [{"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:51:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:51:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:51:16 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:51:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:51:18 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:51:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:51:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:51:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:51:18 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:51:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:51:19 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:51:19 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:51:19 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=24.87625503540039GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:51:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:51:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:51:19 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance db49b877-4758-467f-82a7-7ebc25489972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:51:19 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 4883d7cc-ee48-42d6-aecc-82e68f203441 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:51:19 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:51:19 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:51:19 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:51:19 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG nova.objects.instance [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lazy-loading 'flavor' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:51:20 user nova-compute[75285]: INFO nova.compute.manager [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Attaching volume e35c5937-c347-4391-8f00-e596bc920f4d to /dev/vdb
Nov 10 21:51:20 user nova-compute[75285]: DEBUG os_brick.utils [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec050420-2477-4037-ba8f-c733a1cb4f58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d315102b-6d99-4f8c-ba12-29906a174403]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9e2700-8082-4b8b-a47b-a4ad1c9fb63c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d48d84c-2c2f-4985-8ef1-e79d212f77f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:51:20 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:51:20 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f26e17-41c4-41ba-a0fd-0334dfe7ab8b]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG os_brick.utils [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:51:20 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updating existing volume attachment record: a5f679d9-c09c-4153-a85b-5b0039c3b581 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:51:21 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:51:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:51:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:51:22 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:51:24 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:51:24 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:51:25 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:51:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:51:27 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:51:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:51:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:51:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:51:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:51:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:51:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:51:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:51:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:51:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:51:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOWcGuzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:51:54 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:51:54 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:51:54 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd3b75f-1ad6-4e2e-bc16-e232b5945b8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:51:54 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[652b5a5d-c6f4-4739-a9f0-6a532befe643]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d] added
Nov 10 21:51:54 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f221be10-2c60-4f1d-9da0-65e7a21a109f]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[434b283e-c406-4482-9263-78a0ba129b4e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MOWcGuzs {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MOWcGuzs" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2efce4f-4166-473f-a614-90b34325c5a7]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MOWcGuzs'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b567c06a-7e1e-4830-bdf9-6f1f259b4b51]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[78646831-940e-46dd-98a2-e9c714477945]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:51:54 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:51:54 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83a396b-6122-4d27-91c7-84a497158827]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d, portal: 172.16.0.220,3260]
Nov 10 21:51:54 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d, portal: 172.16.0.220,3260] successful.
Nov 10 21:51:54 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dc2eca-93fd-4b49-9757-6ec2af09c6ea]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c74cf3e-fb85-422c-a094-d78e8698bc35]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:51:54 user nova-compute[75285]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d (non-flash)
Nov 10 21:51:54 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:51:54 user nova-compute[75285]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d (non-flash)
Nov 10 21:51:54 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:51:54 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:51:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:51:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b72034-ad94-47a3-be79-b9b13c33e514]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:51:55 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:51:56 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:51:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOWcGuzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:51:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:51:56 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23264303437646436', 'path': '/dev/sdc'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:51:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264303437646436', 'path': '/dev/sdc'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:51:56 user nova-compute[75285]: DEBUG nova.objects.instance [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lazy-loading 'flavor' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:51:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:51:56 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:51:56 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:51:56 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:51:56 user nova-compute[75285]:   <serial>e35c5937-c347-4391-8f00-e596bc920f4d</serial>
Nov 10 21:51:56 user nova-compute[75285]: </disk>
Nov 10 21:51:56 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:51:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:51:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:51:56 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] No VIF found with MAC fa:16:3e:a2:9e:1b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:51:56 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-46b4fa7e-8c68-4769-a0e1-9d12f59dfeba tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.118s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:51:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:51:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:51:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:51:58 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:51:58 user nova-compute[75285]: INFO nova.compute.manager [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Detaching volume e35c5937-c347-4391-8f00-e596bc920f4d
Nov 10 21:51:58 user nova-compute[75285]: INFO nova.virt.block_device [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Attempting to driver detach volume e35c5937-c347-4391-8f00-e596bc920f4d from mountpoint /dev/vdb
Nov 10 21:51:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Attempting to detach device vdb from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:51:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:51:58 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:51:58 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:51:58 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:51:58 user nova-compute[75285]:   <serial>e35c5937-c347-4391-8f00-e596bc920f4d</serial>
Nov 10 21:51:58 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:51:58 user nova-compute[75285]: </disk>
Nov 10 21:51:58 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:51:58 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Successfully detached device vdb from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the persistent domain config.
Nov 10 21:51:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:51:58 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:51:58 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:51:58 user nova-compute[75285]:   <source dev="/dev/sdc"/>
Nov 10 21:51:58 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:51:58 user nova-compute[75285]:   <serial>e35c5937-c347-4391-8f00-e596bc920f4d</serial>
Nov 10 21:51:58 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:51:58 user nova-compute[75285]: </disk>
Nov 10 21:51:58 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:51:59 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:52:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:05 user nova-compute[75285]: DEBUG nova.compute.manager [req-f73545d7-4e13-42ca-9d85-7eb8d998d388 req-5b2f5d53-845a-4baa-a815-7ac4fdd24c70 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-changed-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:52:05 user nova-compute[75285]: DEBUG nova.compute.manager [req-f73545d7-4e13-42ca-9d85-7eb8d998d388 req-5b2f5d53-845a-4baa-a815-7ac4fdd24c70 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Refreshing instance network info cache due to event network-changed-bf303f2b-484f-4bb9-8f64-e546ee08ea57. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:52:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f73545d7-4e13-42ca-9d85-7eb8d998d388 req-5b2f5d53-845a-4baa-a815-7ac4fdd24c70 service nova] Acquiring lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:52:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f73545d7-4e13-42ca-9d85-7eb8d998d388 req-5b2f5d53-845a-4baa-a815-7ac4fdd24c70 service nova] Acquired lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:52:05 user nova-compute[75285]: DEBUG nova.network.neutron [req-f73545d7-4e13-42ca-9d85-7eb8d998d388 req-5b2f5d53-845a-4baa-a815-7ac4fdd24c70 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Refreshing network info cache for port bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:52:05 user nova-compute[75285]: DEBUG nova.network.neutron [req-f73545d7-4e13-42ca-9d85-7eb8d998d388 req-5b2f5d53-845a-4baa-a815-7ac4fdd24c70 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updated VIF entry in instance network info cache for port bf303f2b-484f-4bb9-8f64-e546ee08ea57. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:52:05 user nova-compute[75285]: DEBUG nova.network.neutron [req-f73545d7-4e13-42ca-9d85-7eb8d998d388 req-5b2f5d53-845a-4baa-a815-7ac4fdd24c70 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updating instance_info_cache with network_info: [{"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:52:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-f73545d7-4e13-42ca-9d85-7eb8d998d388 req-5b2f5d53-845a-4baa-a815-7ac4fdd24c70 service nova] Releasing lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:52:06 user nova-compute[75285]: DEBUG nova.compute.manager [req-cf06a714-3949-4df6-bb5f-701f71ff4730 req-c3d4e075-da18-45cb-9854-89feab4c59de service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-changed-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:52:06 user nova-compute[75285]: DEBUG nova.compute.manager [req-cf06a714-3949-4df6-bb5f-701f71ff4730 req-c3d4e075-da18-45cb-9854-89feab4c59de service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Refreshing instance network info cache due to event network-changed-bf303f2b-484f-4bb9-8f64-e546ee08ea57. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:52:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cf06a714-3949-4df6-bb5f-701f71ff4730 req-c3d4e075-da18-45cb-9854-89feab4c59de service nova] Acquiring lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:52:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cf06a714-3949-4df6-bb5f-701f71ff4730 req-c3d4e075-da18-45cb-9854-89feab4c59de service nova] Acquired lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:52:06 user nova-compute[75285]: DEBUG nova.network.neutron [req-cf06a714-3949-4df6-bb5f-701f71ff4730 req-c3d4e075-da18-45cb-9854-89feab4c59de service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Refreshing network info cache for port bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:52:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:52:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "db49b877-4758-467f-82a7-7ebc25489972" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:52:06 user nova-compute[75285]: INFO nova.compute.manager [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Detaching volume 8bbeacab-9ed7-4dea-9d3c-01e9092fafd8
Nov 10 21:52:06 user nova-compute[75285]: INFO nova.virt.block_device [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Attempting to driver detach volume 8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 from mountpoint /dev/vdb
Nov 10 21:52:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Attempting to detach device vdb from instance db49b877-4758-467f-82a7-7ebc25489972 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:52:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:52:06 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:52:06 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:52:06 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:52:06 user nova-compute[75285]:   <serial>8bbeacab-9ed7-4dea-9d3c-01e9092fafd8</serial>
Nov 10 21:52:06 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 21:52:06 user nova-compute[75285]: </disk>
Nov 10 21:52:06 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:52:06 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Successfully detached device vdb from instance db49b877-4758-467f-82a7-7ebc25489972 from the persistent domain config.
Nov 10 21:52:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance db49b877-4758-467f-82a7-7ebc25489972 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:52:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:52:06 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:52:06 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:52:06 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:52:06 user nova-compute[75285]:   <serial>8bbeacab-9ed7-4dea-9d3c-01e9092fafd8</serial>
Nov 10 21:52:06 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 21:52:06 user nova-compute[75285]: </disk>
Nov 10 21:52:06 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:52:06 user nova-compute[75285]: DEBUG nova.network.neutron [req-cf06a714-3949-4df6-bb5f-701f71ff4730 req-c3d4e075-da18-45cb-9854-89feab4c59de service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updated VIF entry in instance network info cache for port bf303f2b-484f-4bb9-8f64-e546ee08ea57. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:52:06 user nova-compute[75285]: DEBUG nova.network.neutron [req-cf06a714-3949-4df6-bb5f-701f71ff4730 req-c3d4e075-da18-45cb-9854-89feab4c59de service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updating instance_info_cache with network_info: [{"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:52:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-cf06a714-3949-4df6-bb5f-701f71ff4730 req-c3d4e075-da18-45cb-9854-89feab4c59de service nova] Releasing lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:52:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:52:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:11 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:52:11 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:12 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:52:15 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:52:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:52:15 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:52:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:52:15 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:52:15 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: db49b877-4758-467f-82a7-7ebc25489972] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:52:15 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:52:16 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updating instance_info_cache with network_info: [{"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:52:16 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-db49b877-4758-467f-82a7-7ebc25489972" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:52:16 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:52:16 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:52:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:52:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:52:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:52:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:52:16 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:19 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 is timed out.
Nov 10 21:52:19 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Successfully detached device vdb from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the live domain config.
Nov 10 21:52:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOWcGuzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:52:19 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e167d67-c421-40a6-afbe-abe64fcfcd45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:52:19 user nova-compute[75285]: No targets found.
Nov 10 21:52:19 user nova-compute[75285]: iSNS:
Nov 10 21:52:19 user nova-compute[75285]: No targets found.
Nov 10 21:52:19 user nova-compute[75285]: STATIC:
Nov 10 21:52:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d
Nov 10 21:52:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:52:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:52:19 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8
Nov 10 21:52:19 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:52:19 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:52:19 user nova-compute[75285]: FIRMWARE:
Nov 10 21:52:19 user nova-compute[75285]: No targets found.
Nov 10 21:52:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:52:19 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:52:19 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda8d0b4-433b-485a-be26-dfe60c176295]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd1e934-4998-45f7-b288-b73bda39b8dd]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:52:19 user nova-compute[75285]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d (non-flash)
Nov 10 21:52:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:52:19 user nova-compute[75285]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d (non-flash)
Nov 10 21:52:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e4342560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d'): ({'sdc'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Removing single pathed devices sdc {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[344400c1-797b-4889-92ea-ec62ce54ba95]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff931f0-2980-431e-a907-43639d1d1590]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Flushing IO for device /dev/sdc {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebe726d-8ac6-47e1-a703-23d0f19cb87b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1781c32c-4637-40e2-96d7-f57028268046]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] SCSI volumes sdc have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4318e682-4841-4c8f-8fce-d8d6a1d98a39]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7144315-4a03-4132-8ebc-5da06c96c789]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d, portal: 172.16.0.220,3260]
Nov 10 21:52:19 user nova-compute[75285]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d, portal: 172.16.0.220,3260] successful.
Nov 10 21:52:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e35c5937-c347-4391-8f00-e596bc920f4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9188d7-0769-47de-81a2-d40e01631e42]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] <== disconnect_volume: return (297ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:20 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:20 user nova-compute[75285]: DEBUG nova.objects.instance [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lazy-loading 'flavor' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:52:20 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:52:20 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:52:20 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8873MB free_disk=24.87493896484375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:52:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:52:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:52:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-732dda3d-07ca-4f21-a825-98deb3873db0 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.294s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:52:20 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance db49b877-4758-467f-82a7-7ebc25489972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:52:20 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 4883d7cc-ee48-42d6-aecc-82e68f203441 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:52:20 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:52:20 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:52:20 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:52:21 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:52:21 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:52:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:52:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:22 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:52:22 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:52:25 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:52:25 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:52:26 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance db49b877-4758-467f-82a7-7ebc25489972 is timed out.
Nov 10 21:52:26 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Successfully detached device vdb from instance db49b877-4758-467f-82a7-7ebc25489972 from the live domain config.
Nov 10 21:52:26 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGIMuKVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:52:26 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:52:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1d3b02-801a-4344-8c5d-bb6df23c88a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:52:26 user nova-compute[75285]: No targets found.
Nov 10 21:52:26 user nova-compute[75285]: iSNS:
Nov 10 21:52:26 user nova-compute[75285]: No targets found.
Nov 10 21:52:26 user nova-compute[75285]: STATIC:
Nov 10 21:52:26 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8
Nov 10 21:52:26 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:52:26 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:52:26 user nova-compute[75285]: FIRMWARE:
Nov 10 21:52:26 user nova-compute[75285]: No targets found.
Nov 10 21:52:26 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:52:26 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:52:26 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6065475f-6941-4a75-8af6-e7e55df51a33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1d23e8-ee3c-4d5c-92ed-71a05ca14e2c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:52:26 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 (non-flash)
Nov 10 21:52:26 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4a085d2830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb9fa43-a0ef-4cf6-a72f-86694069bb81]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9729ca2d-c9ab-4a8a-b58c-b59658fab778]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:52:26 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4fe135-0069-4fd5-b23c-b473331f3639]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3907de-b966-4f6b-a343-a6fea6c4dde4]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f41485-4ae2-420a-94e6-800d3a53e9a4]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c8cecf-09ac-43c8-8e36-c9be71bf4833]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260]
Nov 10 21:52:27 user nova-compute[75285]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8, portal: 172.16.0.220,3260] successful.
Nov 10 21:52:27 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bbeacab-9ed7-4dea-9d3c-01e9092fafd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c2f956-86e4-423d-9c58-1aa1bda55689]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] <== disconnect_volume: return (293ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:52:27 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:52:28 user nova-compute[75285]: DEBUG nova.objects.instance [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'flavor' on Instance uuid db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:52:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-867a9070-0231-4752-a3c6-fdac45ffaf22 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "db49b877-4758-467f-82a7-7ebc25489972" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.893s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:52:28 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:52:31 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:52:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:52:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:52:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:52:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:52:41 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:46 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:51 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:52:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:52:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:52:54 user nova-compute[75285]: DEBUG nova.objects.instance [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lazy-loading 'flavor' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:52:54 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:52:55 user nova-compute[75285]: INFO nova.compute.manager [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Attaching volume 13212162-e4b2-402a-a281-5dca2f7e1fe1 to /dev/vdb
Nov 10 21:52:55 user nova-compute[75285]: DEBUG os_brick.utils [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9bcd04-fdb2-4bb8-8ed2-baf5b251ab52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8479fc70-3dbc-4cb7-983c-4ccc817cfcc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc1c31a-3c27-4c95-8dc0-8a833ea36e42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4480f9c9-aa8f-4ba1-8f2d-f82b5c723b0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:52:55 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:52:55 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a106d6-884c-4e3e-bc4e-e3f569dc6d3b]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG os_brick.utils [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:52:55 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updating existing volume attachment record: 432f2b2d-f86a-4d53-b997-405692326c41 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:52:56 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:52:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:01 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:53:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:53:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:53:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:53:06 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "db49b877-4758-467f-82a7-7ebc25489972" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:53:08 user nova-compute[75285]: INFO nova.compute.manager [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Terminating instance
Nov 10 21:53:08 user nova-compute[75285]: DEBUG nova.compute.manager [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG nova.compute.manager [req-6b05b976-8d06-43f1-9ddf-f7a10c8263be req-52ee7d61-6d84-47cd-88a6-425d8f5f496c service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-vif-unplugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6b05b976-8d06-43f1-9ddf-f7a10c8263be req-52ee7d61-6d84-47cd-88a6-425d8f5f496c service nova] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6b05b976-8d06-43f1-9ddf-f7a10c8263be req-52ee7d61-6d84-47cd-88a6-425d8f5f496c service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6b05b976-8d06-43f1-9ddf-f7a10c8263be req-52ee7d61-6d84-47cd-88a6-425d8f5f496c service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG nova.compute.manager [req-6b05b976-8d06-43f1-9ddf-f7a10c8263be req-52ee7d61-6d84-47cd-88a6-425d8f5f496c service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] No waiting events found dispatching network-vif-unplugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:53:08 user nova-compute[75285]: DEBUG nova.compute.manager [req-6b05b976-8d06-43f1-9ddf-f7a10c8263be req-52ee7d61-6d84-47cd-88a6-425d8f5f496c service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-vif-unplugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:09 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: db49b877-4758-467f-82a7-7ebc25489972] Instance destroyed successfully.
Nov 10 21:53:09 user nova-compute[75285]: DEBUG nova.objects.instance [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'resources' on Instance uuid db49b877-4758-467f-82a7-7ebc25489972 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1664109897',display_name='tempest-TestMinimumBasicScenario-server-1664109897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1664109897',id=48,image_ref='b2824634-ff9e-4ae5-9da6-b66d3f04d1dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuVMYmNRx64Pj7St2vh0O+0SlHGGlAdvL6wrmO53jHjMBiD/xn7M1S7npOfjsPKn1tR47m1uzoKo8UVzlR3nLHkXdGDp3ZuOFtAKQkBjk0u+ctBgPCmISWi1+ZXIlHY0w==',key_name='tempest-TestMinimumBasicScenario-1404195034',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:47:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5be8bdaa0904649a3942a800ab22520',ramdisk_id='',reservation_id='r-5irnhmq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b2824634-ff9e-4ae5-9da6-b66d3f04d1dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546154678',owner_user_name='tempest-TestMinimumBasicScenario-546154678-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:50:21Z,user_data=None,user_id='face290806c0494b956c6574c086fda8',uuid=db49b877-4758-467f-82a7-7ebc25489972,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converting VIF {"id": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "address": "fa:16:3e:da:79:d6", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf303f2b-48", "ovs_interfaceid": "bf303f2b-484f-4bb9-8f64-e546ee08ea57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf303f2b-484f-4bb9-8f64-e546ee08ea57,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf303f2b-48') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG os_vif [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf303f2b-484f-4bb9-8f64-e546ee08ea57,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf303f2b-48') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf303f2b-48, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91b14ad6-2dbc-4e23-8b17-e3e549db77f2) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:53:09 user nova-compute[75285]: INFO os_vif [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf303f2b-484f-4bb9-8f64-e546ee08ea57,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf303f2b-48')
Nov 10 21:53:09 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Deleting instance files /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972_del
Nov 10 21:53:09 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Deletion of /opt/stack/data/nova/instances/db49b877-4758-467f-82a7-7ebc25489972_del complete
Nov 10 21:53:09 user nova-compute[75285]: INFO nova.compute.manager [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: db49b877-4758-467f-82a7-7ebc25489972] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 10 21:53:09 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: db49b877-4758-467f-82a7-7ebc25489972] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:53:09 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: db49b877-4758-467f-82a7-7ebc25489972] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:53:10 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: db49b877-4758-467f-82a7-7ebc25489972] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:53:10 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: db49b877-4758-467f-82a7-7ebc25489972] Took 0.59 seconds to deallocate network for instance.
Nov 10 21:53:10 user nova-compute[75285]: DEBUG nova.compute.manager [req-35883399-64ef-41b4-86c0-5dd23abda6e5 req-9aab562f-0002-4b2f-bf30-cfefc137bdc2 service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-vif-deleted-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:53:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:53:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:53:10 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:53:10 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:53:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:53:10 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Deleted allocations for instance db49b877-4758-467f-82a7-7ebc25489972
Nov 10 21:53:10 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-2eb4ed9c-ee85-4bb6-936f-fb9997e0b80e tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "db49b877-4758-467f-82a7-7ebc25489972" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.839s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:53:11 user nova-compute[75285]: DEBUG nova.compute.manager [req-bc0f2f29-5999-475b-b9f2-e11683c9ec77 req-575c7825-93b8-4200-bb05-5e8d7425248e service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received event network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:53:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bc0f2f29-5999-475b-b9f2-e11683c9ec77 req-575c7825-93b8-4200-bb05-5e8d7425248e service nova] Acquiring lock "db49b877-4758-467f-82a7-7ebc25489972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:53:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bc0f2f29-5999-475b-b9f2-e11683c9ec77 req-575c7825-93b8-4200-bb05-5e8d7425248e service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:53:11 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bc0f2f29-5999-475b-b9f2-e11683c9ec77 req-575c7825-93b8-4200-bb05-5e8d7425248e service nova] Lock "db49b877-4758-467f-82a7-7ebc25489972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:53:11 user nova-compute[75285]: DEBUG nova.compute.manager [req-bc0f2f29-5999-475b-b9f2-e11683c9ec77 req-575c7825-93b8-4200-bb05-5e8d7425248e service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] No waiting events found dispatching network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:53:11 user nova-compute[75285]: WARNING nova.compute.manager [req-bc0f2f29-5999-475b-b9f2-e11683c9ec77 req-575c7825-93b8-4200-bb05-5e8d7425248e service nova] [instance: db49b877-4758-467f-82a7-7ebc25489972] Received unexpected event network-vif-plugged-bf303f2b-484f-4bb9-8f64-e546ee08ea57 for instance with vm_state deleted and task_state None.
Nov 10 21:53:11 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:53:12 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:53:14 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:17 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:53:17 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:53:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:53:17 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:53:17 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updating instance_info_cache with network_info: [{"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VyDMlKgq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:53:18 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:53:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:53:18 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:53:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:53:18 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e502a12-e5e9-407d-aee3-ededb349fb57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:53:18 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b997afa9-5b24-4764-9661-5ce888b46de6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1] added
Nov 10 21:53:18 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef44d56b-a0fd-4288-91da-c41d0bd95250]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe8d4c1-f423-45c7-87ed-373494659232]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VyDMlKgq {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VyDMlKgq" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f0f884-7ead-43fe-a4e3-fbb7eaa86b9d]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VyDMlKgq'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f981a936-9b69-49dd-8cb5-860eec18f4bd]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:53:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[350e4c0e-96e8-4f1d-90ae-d2ea4e97c4a2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:53:19 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:53:19 user nova-compute[75285]:  {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:53:19 user nova-compute[75285]: WARNING os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 21:53:19 user nova-compute[75285]: 
Nov 10 21:53:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b950d249-9944-4f2e-8d14-917350b8551b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1, portal: 172.16.0.220,3260]
Nov 10 21:53:19 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1, portal: 172.16.0.220,3260] successful.
Nov 10 21:53:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[60de4e6b-3b27-4a80-acea-b5493d8e1496]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[748d87a2-7815-456f-8022-dffa12e77559]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 (non-flash)
Nov 10 21:53:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 (non-flash)
Nov 10 21:53:19 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[31653642-b3ee-4bff-bfae-6b7657e9883e]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VyDMlKgq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:53:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:53:20 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23532666239396634', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:53:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532666239396634', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:53:20 user nova-compute[75285]: DEBUG nova.objects.instance [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lazy-loading 'flavor' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:53:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:53:20 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:53:20 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:53:20 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:53:20 user nova-compute[75285]:   <serial>13212162-e4b2-402a-a281-5dca2f7e1fe1</serial>
Nov 10 21:53:20 user nova-compute[75285]: </disk>
Nov 10 21:53:20 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:53:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:53:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:53:20 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] No VIF found with MAC fa:16:3e:a2:9e:1b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:53:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-e01a330e-988a-4a29-b007-20505f95001e tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.566s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:53:21 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:53:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:53:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:53:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:53:21 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:53:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:21 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:53:22 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:53:22 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:53:22 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=24.901775360107422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:53:22 user nova-compute[75285]: INFO nova.compute.manager [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Detaching volume 13212162-e4b2-402a-a281-5dca2f7e1fe1
Nov 10 21:53:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 4883d7cc-ee48-42d6-aecc-82e68f203441 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:53:22 user nova-compute[75285]: INFO nova.virt.block_device [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Attempting to driver detach volume 13212162-e4b2-402a-a281-5dca2f7e1fe1 from mountpoint /dev/vdb
Nov 10 21:53:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Attempting to detach device vdb from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:53:22 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:53:22 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:53:22 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:53:22 user nova-compute[75285]:   <serial>13212162-e4b2-402a-a281-5dca2f7e1fe1</serial>
Nov 10 21:53:22 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:53:22 user nova-compute[75285]: </disk>
Nov 10 21:53:22 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:53:22 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Successfully detached device vdb from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the persistent domain config.
Nov 10 21:53:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:53:22 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:53:22 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:53:22 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:53:22 user nova-compute[75285]:   <serial>13212162-e4b2-402a-a281-5dca2f7e1fe1</serial>
Nov 10 21:53:22 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:53:22 user nova-compute[75285]: </disk>
Nov 10 21:53:22 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:53:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:53:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:53:23 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:53:23 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:53:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:27 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:53:27 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:53:29 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:53:30 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:53:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:39 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:43 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 is timed out.
Nov 10 21:53:43 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Successfully detached device vdb from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the live domain config.
Nov 10 21:53:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VyDMlKgq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:53:43 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[878dba32-63de-4bf4-8a3f-f5419cac5efc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:53:43 user nova-compute[75285]: No targets found.
Nov 10 21:53:43 user nova-compute[75285]: iSNS:
Nov 10 21:53:43 user nova-compute[75285]: No targets found.
Nov 10 21:53:43 user nova-compute[75285]: STATIC:
Nov 10 21:53:43 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1
Nov 10 21:53:43 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:53:43 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:53:43 user nova-compute[75285]: FIRMWARE:
Nov 10 21:53:43 user nova-compute[75285]: No targets found.
Nov 10 21:53:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:53:43 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:53:43 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c00999-9a3d-4b29-b1f0-a9f7ca3bebc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe7aada-3383-46f0-b9f3-816dee6f4746]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 (non-flash)
Nov 10 21:53:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 (non-flash)
Nov 10 21:53:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e43048b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[868660dd-97ad-45e5-af6b-136249ac8da0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[320f0e0d-00d6-47b1-9ca4-7577b4131db8]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc0a1c2-ff63-4d0a-99c5-2c292c0c13f0]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd48a13b-8265-41ba-9d64-dad22fd54f2b]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9889c6d7-18d4-49d6-b614-cbf3972164bd]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3f93a2-1151-42c3-89e3-dd10a15e68dd]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1, portal: 172.16.0.220,3260]
Nov 10 21:53:43 user nova-compute[75285]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1, portal: 172.16.0.220,3260] successful.
Nov 10 21:53:43 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13212162-e4b2-402a-a281-5dca2f7e1fe1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceba3fb-c711-479f-a29b-84e2c9b7273e]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] <== disconnect_volume: return (292ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:53:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:53:44 user nova-compute[75285]: DEBUG nova.objects.instance [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lazy-loading 'flavor' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:53:44 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-f15cb6ee-b411-4fac-9e39-31e180ea40de tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.860s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:53:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:53:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:53:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:53:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:53:44 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:49 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:54 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:53:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:54:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:54:02 user nova-compute[75285]: DEBUG nova.compute.manager [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Starting instance... {{(pid=75285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 21:54:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:54:02 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:54:02 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 21:54:02 user nova-compute[75285]: INFO nova.compute.claims [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Claim successful on node user
Nov 10 21:54:03 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG nova.compute.manager [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Start building networks asynchronously for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG nova.compute.manager [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Allocating IP information in the background. {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG nova.network.neutron [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] allocate_for_instance() {{(pid=75285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 21:54:03 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 21:54:03 user nova-compute[75285]: DEBUG nova.compute.manager [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Start building block device mappings for instance. {{(pid=75285) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG nova.compute.manager [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Start spawning the instance on the hypervisor. {{(pid=75285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Creating instance directory {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 21:54:03 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Creating image(s)
Nov 10 21:54:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "/opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "/opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "d413a33891f4a4daf00b267fecde17d7d628bff9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "d413a33891f4a4daf00b267fecde17d7d628bff9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9.part --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG nova.policy [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'face290806c0494b956c6574c086fda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5be8bdaa0904649a3942a800ab22520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75285) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9.part --force-share --output=json" returned: 0 in 0.172s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG nova.virt.images [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] a68dd8bc-e8ff-41f7-bdef-f56b1548a7c3 was qcow2, converting to raw {{(pid=75285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG nova.privsep.utils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 21:54:03 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9.part /opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9.converted {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9.part /opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9.converted" returned: 0 in 0.178s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9.converted --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG nova.network.neutron [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Successfully created port: 5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "d413a33891f4a4daf00b267fecde17d7d628bff9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.008s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9 --force-share --output=json" returned: 0 in 0.293s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "d413a33891f4a4daf00b267fecde17d7d628bff9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "d413a33891f4a4daf00b267fecde17d7d628bff9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9 --force-share --output=json" returned: 0 in 0.235s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9,backing_fmt=raw /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk 1073741824 {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9,backing_fmt=raw /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk 1073741824" returned: 0 in 0.050s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "d413a33891f4a4daf00b267fecde17d7d628bff9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:54:04 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9 --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d413a33891f4a4daf00b267fecde17d7d628bff9 --force-share --output=json" returned: 0 in 0.193s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk. size=1073741824 {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.network.neutron [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Successfully updated port: 5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquired lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.network.neutron [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.compute.manager [req-0b242425-7b1c-400f-89c3-435514b9d3ba req-61d5f737-69e2-4780-af8b-21fb9e398dc1 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-changed-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.compute.manager [req-0b242425-7b1c-400f-89c3-435514b9d3ba req-61d5f737-69e2-4780-af8b-21fb9e398dc1 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Refreshing instance network info cache due to event network-changed-5271ced0-40fa-45d5-a118-44866a5b29a0. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0b242425-7b1c-400f-89c3-435514b9d3ba req-61d5f737-69e2-4780-af8b-21fb9e398dc1 service nova] Acquiring lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.network.neutron [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Instance cache missing network info. {{(pid=75285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.disk.api [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Cannot resize image /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk to a smaller size. {{(pid=75285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Created local disks {{(pid=75285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Ensure instance console log exists: /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/console.log {{(pid=75285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.network.neutron [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updating instance_info_cache with network_info: [{"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Releasing lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.compute.manager [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Instance network_info: |[{"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0b242425-7b1c-400f-89c3-435514b9d3ba req-61d5f737-69e2-4780-af8b-21fb9e398dc1 service nova] Acquired lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.network.neutron [req-0b242425-7b1c-400f-89c3-435514b9d3ba req-61d5f737-69e2-4780-af8b-21fb9e398dc1 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Refreshing network info cache for port 5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Start _get_guest_xml network_info=[{"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T21:54:00Z,direct_url=<?>,disk_format='qcow2',id=a68dd8bc-e8ff-41f7-bdef-f56b1548a7c3,min_disk=0,min_ram=0,name='tempest-scenario-img--1053480909',owner='c5be8bdaa0904649a3942a800ab22520',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T21:54:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'a68dd8bc-e8ff-41f7-bdef-f56b1548a7c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 21:54:05 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:54:05 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CPU controller missing on host. {{(pid=75285) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.host [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CPU controller found on host. {{(pid=75285) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T20:58:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T21:54:00Z,direct_url=<?>,disk_format='qcow2',id=a68dd8bc-e8ff-41f7-bdef-f56b1548a7c3,min_disk=0,min_ram=0,name='tempest-scenario-img--1053480909',owner='c5be8bdaa0904649a3942a800ab22520',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T21:54:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Flavor limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Image limits 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Flavor pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Image pref 0:0:0 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Got 1 possible topologies {{(pid=75285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.hardware [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:54:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-603890020',display_name='tempest-TestMinimumBasicScenario-server-603890020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-603890020',id=50,image_ref='a68dd8bc-e8ff-41f7-bdef-f56b1548a7c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCT1qfvuqQyGq9zfvnOxO4HBhGlLPkuHXPrXeoElBRy8l2Y2wn8+CUdcAqYSi2XRd+7SGqTi2cARQGIynUW/tlsD+xAY+yotDxyzQNZutQCQxnBZoSD5Rn3493B8Lyq96A==',key_name='tempest-TestMinimumBasicScenario-1980357873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5be8bdaa0904649a3942a800ab22520',ramdisk_id='',reservation_id='r-60ldg1mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a68dd8bc-e8ff-41f7-bdef-f56b1548a7c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-546154678',owner_user_name='tempest-TestMinimumBasicScenario-546154678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:54:03Z,user_data=None,user_id='face290806c0494b956c6574c086fda8',uuid=c4e906e8-15da-44c3-ac2a-d4b71dd28cad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converting VIF {"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:28:bb,bridge_name='br-int',has_traffic_filtering=True,id=5271ced0-40fa-45d5-a118-44866a5b29a0,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5271ced0-40') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.objects.instance [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'pci_devices' on Instance uuid c4e906e8-15da-44c3-ac2a-d4b71dd28cad {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] End _get_guest_xml xml=<domain type="kvm">
Nov 10 21:54:05 user nova-compute[75285]:   <uuid>c4e906e8-15da-44c3-ac2a-d4b71dd28cad</uuid>
Nov 10 21:54:05 user nova-compute[75285]:   <name>instance-00000032</name>
Nov 10 21:54:05 user nova-compute[75285]:   <memory>524288</memory>
Nov 10 21:54:05 user nova-compute[75285]:   <vcpu>1</vcpu>
Nov 10 21:54:05 user nova-compute[75285]:   <metadata>
Nov 10 21:54:05 user nova-compute[75285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 21:54:05 user nova-compute[75285]:       <nova:package version="0.0.0"/>
Nov 10 21:54:05 user nova-compute[75285]:       <nova:name>tempest-TestMinimumBasicScenario-server-603890020</nova:name>
Nov 10 21:54:05 user nova-compute[75285]:       <nova:creationTime>2023-11-10 21:54:05</nova:creationTime>
Nov 10 21:54:05 user nova-compute[75285]:       <nova:flavor name="m1.tiny">
Nov 10 21:54:05 user nova-compute[75285]:         <nova:memory>512</nova:memory>
Nov 10 21:54:05 user nova-compute[75285]:         <nova:disk>1</nova:disk>
Nov 10 21:54:05 user nova-compute[75285]:         <nova:swap>0</nova:swap>
Nov 10 21:54:05 user nova-compute[75285]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 21:54:05 user nova-compute[75285]:         <nova:vcpus>1</nova:vcpus>
Nov 10 21:54:05 user nova-compute[75285]:       </nova:flavor>
Nov 10 21:54:05 user nova-compute[75285]:       <nova:owner>
Nov 10 21:54:05 user nova-compute[75285]:         <nova:user uuid="face290806c0494b956c6574c086fda8">tempest-TestMinimumBasicScenario-546154678-project-member</nova:user>
Nov 10 21:54:05 user nova-compute[75285]:         <nova:project uuid="c5be8bdaa0904649a3942a800ab22520">tempest-TestMinimumBasicScenario-546154678</nova:project>
Nov 10 21:54:05 user nova-compute[75285]:       </nova:owner>
Nov 10 21:54:05 user nova-compute[75285]:       <nova:root type="image" uuid="a68dd8bc-e8ff-41f7-bdef-f56b1548a7c3"/>
Nov 10 21:54:05 user nova-compute[75285]:       <nova:ports>
Nov 10 21:54:05 user nova-compute[75285]:         <nova:port uuid="5271ced0-40fa-45d5-a118-44866a5b29a0">
Nov 10 21:54:05 user nova-compute[75285]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 21:54:05 user nova-compute[75285]:         </nova:port>
Nov 10 21:54:05 user nova-compute[75285]:       </nova:ports>
Nov 10 21:54:05 user nova-compute[75285]:     </nova:instance>
Nov 10 21:54:05 user nova-compute[75285]:   </metadata>
Nov 10 21:54:05 user nova-compute[75285]:   <sysinfo type="smbios">
Nov 10 21:54:05 user nova-compute[75285]:     <system>
Nov 10 21:54:05 user nova-compute[75285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 21:54:05 user nova-compute[75285]:       <entry name="product">OpenStack Nova</entry>
Nov 10 21:54:05 user nova-compute[75285]:       <entry name="version">0.0.0</entry>
Nov 10 21:54:05 user nova-compute[75285]:       <entry name="serial">c4e906e8-15da-44c3-ac2a-d4b71dd28cad</entry>
Nov 10 21:54:05 user nova-compute[75285]:       <entry name="uuid">c4e906e8-15da-44c3-ac2a-d4b71dd28cad</entry>
Nov 10 21:54:05 user nova-compute[75285]:       <entry name="family">Virtual Machine</entry>
Nov 10 21:54:05 user nova-compute[75285]:     </system>
Nov 10 21:54:05 user nova-compute[75285]:   </sysinfo>
Nov 10 21:54:05 user nova-compute[75285]:   <os>
Nov 10 21:54:05 user nova-compute[75285]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 21:54:05 user nova-compute[75285]:     <boot dev="hd"/>
Nov 10 21:54:05 user nova-compute[75285]:     <smbios mode="sysinfo"/>
Nov 10 21:54:05 user nova-compute[75285]:   </os>
Nov 10 21:54:05 user nova-compute[75285]:   <features>
Nov 10 21:54:05 user nova-compute[75285]:     <acpi/>
Nov 10 21:54:05 user nova-compute[75285]:     <apic/>
Nov 10 21:54:05 user nova-compute[75285]:     <vmcoreinfo/>
Nov 10 21:54:05 user nova-compute[75285]:   </features>
Nov 10 21:54:05 user nova-compute[75285]:   <clock offset="utc">
Nov 10 21:54:05 user nova-compute[75285]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 21:54:05 user nova-compute[75285]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 21:54:05 user nova-compute[75285]:     <timer name="hpet" present="no"/>
Nov 10 21:54:05 user nova-compute[75285]:   </clock>
Nov 10 21:54:05 user nova-compute[75285]:   <cpu mode="custom" match="exact">
Nov 10 21:54:05 user nova-compute[75285]:     <model>Nehalem</model>
Nov 10 21:54:05 user nova-compute[75285]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 21:54:05 user nova-compute[75285]:   </cpu>
Nov 10 21:54:05 user nova-compute[75285]:   <devices>
Nov 10 21:54:05 user nova-compute[75285]:     <disk type="file" device="disk">
Nov 10 21:54:05 user nova-compute[75285]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 21:54:05 user nova-compute[75285]:       <source file="/opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk"/>
Nov 10 21:54:05 user nova-compute[75285]:       <target dev="vda" bus="virtio"/>
Nov 10 21:54:05 user nova-compute[75285]:     </disk>
Nov 10 21:54:05 user nova-compute[75285]:     <interface type="ethernet">
Nov 10 21:54:05 user nova-compute[75285]:       <mac address="fa:16:3e:78:28:bb"/>
Nov 10 21:54:05 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:54:05 user nova-compute[75285]:       <mtu size="1442"/>
Nov 10 21:54:05 user nova-compute[75285]:       <target dev="tap5271ced0-40"/>
Nov 10 21:54:05 user nova-compute[75285]:     </interface>
Nov 10 21:54:05 user nova-compute[75285]:     <serial type="pty">
Nov 10 21:54:05 user nova-compute[75285]:       <log file="/opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/console.log" append="off"/>
Nov 10 21:54:05 user nova-compute[75285]:     </serial>
Nov 10 21:54:05 user nova-compute[75285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 21:54:05 user nova-compute[75285]:     <video>
Nov 10 21:54:05 user nova-compute[75285]:       <model type="virtio"/>
Nov 10 21:54:05 user nova-compute[75285]:     </video>
Nov 10 21:54:05 user nova-compute[75285]:     <rng model="virtio">
Nov 10 21:54:05 user nova-compute[75285]:       <backend model="random">/dev/urandom</backend>
Nov 10 21:54:05 user nova-compute[75285]:     </rng>
Nov 10 21:54:05 user nova-compute[75285]:     <controller type="usb" index="0" model="none"/>
Nov 10 21:54:05 user nova-compute[75285]:     <memballoon model="virtio">
Nov 10 21:54:05 user nova-compute[75285]:       <stats period="10"/>
Nov 10 21:54:05 user nova-compute[75285]:     </memballoon>
Nov 10 21:54:05 user nova-compute[75285]:   </devices>
Nov 10 21:54:05 user nova-compute[75285]: </domain>
Nov 10 21:54:05 user nova-compute[75285]:  {{(pid=75285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:54:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-603890020',display_name='tempest-TestMinimumBasicScenario-server-603890020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-603890020',id=50,image_ref='a68dd8bc-e8ff-41f7-bdef-f56b1548a7c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCT1qfvuqQyGq9zfvnOxO4HBhGlLPkuHXPrXeoElBRy8l2Y2wn8+CUdcAqYSi2XRd+7SGqTi2cARQGIynUW/tlsD+xAY+yotDxyzQNZutQCQxnBZoSD5Rn3493B8Lyq96A==',key_name='tempest-TestMinimumBasicScenario-1980357873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5be8bdaa0904649a3942a800ab22520',ramdisk_id='',reservation_id='r-60ldg1mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a68dd8bc-e8ff-41f7-bdef-f56b1548a7c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-546154678',owner_user_name='tempest-TestMinimumBasicScenario-546154678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T21:54:03Z,user_data=None,user_id='face290806c0494b956c6574c086fda8',uuid=c4e906e8-15da-44c3-ac2a-d4b71dd28cad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converting VIF {"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:28:bb,bridge_name='br-int',has_traffic_filtering=True,id=5271ced0-40fa-45d5-a118-44866a5b29a0,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5271ced0-40') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG os_vif [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:28:bb,bridge_name='br-int',has_traffic_filtering=True,id=5271ced0-40fa-45d5-a118-44866a5b29a0,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5271ced0-40') {{(pid=75285) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ca05bef-9d37-5697-a2e8-1ee1e0ad9950', '_type': 'linux-noop'}}, row=False) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5271ced0-40, may_exist=True, interface_attrs={}) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5271ced0-40, col_values=(('qos', UUID('29ea25b0-a74f-4247-b9d9-24f1e61c95c2')),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5271ced0-40, col_values=(('external_ids', {'iface-id': '5271ced0-40fa-45d5-a118-44866a5b29a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:28:bb', 'vm-uuid': 'c4e906e8-15da-44c3-ac2a-d4b71dd28cad'}),), if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:05 user nova-compute[75285]: INFO os_vif [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:28:bb,bridge_name='br-int',has_traffic_filtering=True,id=5271ced0-40fa-45d5-a118-44866a5b29a0,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5271ced0-40')
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:54:05 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] No VIF found with MAC fa:16:3e:78:28:bb, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:54:06 user nova-compute[75285]: DEBUG nova.network.neutron [req-0b242425-7b1c-400f-89c3-435514b9d3ba req-61d5f737-69e2-4780-af8b-21fb9e398dc1 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updated VIF entry in instance network info cache for port 5271ced0-40fa-45d5-a118-44866a5b29a0. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:54:06 user nova-compute[75285]: DEBUG nova.network.neutron [req-0b242425-7b1c-400f-89c3-435514b9d3ba req-61d5f737-69e2-4780-af8b-21fb9e398dc1 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updating instance_info_cache with network_info: [{"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:54:06 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-0b242425-7b1c-400f-89c3-435514b9d3ba req-61d5f737-69e2-4780-af8b-21fb9e398dc1 service nova] Releasing lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:54:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-fdcfb258-196d-4e33-992e-6dcd862179f8 req-860b1edf-6dad-4062-a595-3051dfac97d0 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:54:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fdcfb258-196d-4e33-992e-6dcd862179f8 req-860b1edf-6dad-4062-a595-3051dfac97d0 service nova] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:54:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fdcfb258-196d-4e33-992e-6dcd862179f8 req-860b1edf-6dad-4062-a595-3051dfac97d0 service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:54:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-fdcfb258-196d-4e33-992e-6dcd862179f8 req-860b1edf-6dad-4062-a595-3051dfac97d0 service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:54:07 user nova-compute[75285]: DEBUG nova.compute.manager [req-fdcfb258-196d-4e33-992e-6dcd862179f8 req-860b1edf-6dad-4062-a595-3051dfac97d0 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] No waiting events found dispatching network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:54:07 user nova-compute[75285]: WARNING nova.compute.manager [req-fdcfb258-196d-4e33-992e-6dcd862179f8 req-860b1edf-6dad-4062-a595-3051dfac97d0 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received unexpected event network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 for instance with vm_state building and task_state spawning.
Nov 10 21:54:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Instance event wait completed in 0 seconds for  {{(pid=75285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 21:54:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Guest created on hypervisor {{(pid=75285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 21:54:09 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Instance spawned successfully.
Nov 10 21:54:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 21:54:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Found default for hw_cdrom_bus of ide {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:54:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Found default for hw_disk_bus of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:54:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Found default for hw_input_bus of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:54:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Found default for hw_pointer_model of None {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:54:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Found default for hw_video_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:54:09 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Found default for hw_vif_model of virtio {{(pid=75285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 21:54:09 user nova-compute[75285]: INFO nova.compute.manager [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 10 21:54:09 user nova-compute[75285]: DEBUG nova.compute.manager [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:54:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-c57d12e3-cfa8-4811-8fae-e1624cc3ef9c req-78051782-5482-49a5-ab3f-2954299d126d service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:54:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c57d12e3-cfa8-4811-8fae-e1624cc3ef9c req-78051782-5482-49a5-ab3f-2954299d126d service nova] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:54:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c57d12e3-cfa8-4811-8fae-e1624cc3ef9c req-78051782-5482-49a5-ab3f-2954299d126d service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:54:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c57d12e3-cfa8-4811-8fae-e1624cc3ef9c req-78051782-5482-49a5-ab3f-2954299d126d service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:54:09 user nova-compute[75285]: DEBUG nova.compute.manager [req-c57d12e3-cfa8-4811-8fae-e1624cc3ef9c req-78051782-5482-49a5-ab3f-2954299d126d service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] No waiting events found dispatching network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:54:09 user nova-compute[75285]: WARNING nova.compute.manager [req-c57d12e3-cfa8-4811-8fae-e1624cc3ef9c req-78051782-5482-49a5-ab3f-2954299d126d service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received unexpected event network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 for instance with vm_state building and task_state spawning.
Nov 10 21:54:09 user nova-compute[75285]: INFO nova.compute.manager [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Took 6.69 seconds to build instance.
Nov 10 21:54:09 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-94938ff6-85ad-4beb-aed6-ee7ba163641d tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.798s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:54:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:12 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:12 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:54:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:54:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:17 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:54:17 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 21:54:17 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] There are 0 instances to clean {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 21:54:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:54:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:54:18 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lazy-loading 'flavor' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:54:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:54:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:54:18 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:54:18 user nova-compute[75285]: INFO nova.compute.manager [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Attaching volume 9aaa6157-02f2-41e6-bc67-eebf80ec88c8 to /dev/vdb
Nov 10 21:54:18 user nova-compute[75285]: DEBUG os_brick.utils [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:54:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e16ee2-a292-41be-bd48-e6ef7d4ee8b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:18 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9358a3e-6151-470b-8d61-efb121892b83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:18 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[85601c93-e087-4790-931f-e6417a44eb22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea746115-265c-41ca-8185-fd5264c0ef08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:54:19 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:54:19 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ece238-fd95-413b-aaac-e35dab5115bc]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG os_brick.utils [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updating existing volume attachment record: 593b8564-1c20-43d8-bf31-2a4530ce72cd {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:54:19 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:54:20 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updating instance_info_cache with network_info: [{"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:54:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:54:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:54:20 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:54:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:54:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:54:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:54:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:54:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:22 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:22 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:54:22 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:54:22 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:54:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:54:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:54:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:54:22 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:54:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:23 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:54:23 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:54:23 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8831MB free_disk=24.878742218017578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:54:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:54:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:54:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 4883d7cc-ee48-42d6-aecc-82e68f203441 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:54:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c4e906e8-15da-44c3-ac2a-d4b71dd28cad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:54:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:54:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:54:24 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing inventories for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 21:54:24 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating ProviderTree inventory for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 21:54:24 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating inventory in ProviderTree for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 21:54:24 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing aggregate associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, aggregates: None {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 21:54:24 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing trait associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 21:54:24 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:54:24 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:54:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:54:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:54:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:54:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:54:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:54:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:36 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:54:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YlzVagCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:54:41 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:54:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:54:41 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:54:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:54:41 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e466e91d-a277-4b2f-ab97-3f9110d307f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:54:41 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[178aed37-06d2-4efe-afa0-504b9895b99e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8] added
Nov 10 21:54:41 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1799a272-c49d-4390-a4e3-d89db2bb468c]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6e2fa6-ba04-4ff4-8111-e50766a18369]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YlzVagCi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YlzVagCi" returned: 0 in 0.022s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[01176cdd-8ae4-4576-86cb-96c9d3aa3ebc]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YlzVagCi'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6e8105-23f0-461d-8b94-4b12b9f86165]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:54:41 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f67345b-e439-49d1-bc49-0126c463a098]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:54:42 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:54:42 user nova-compute[75285]:  {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:54:42 user nova-compute[75285]: WARNING os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 21:54:42 user nova-compute[75285]: 
Nov 10 21:54:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8842c0ea-c5e7-41e7-9dc2-7fbe074401cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8, portal: 172.16.0.220,3260]
Nov 10 21:54:42 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8, portal: 172.16.0.220,3260] successful.
Nov 10 21:54:42 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb4b4d0-3a8a-4ba6-b5a9-db7387fd2d9b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a509d4cf-0a83-4613-9fea-abc7f9eb0bde]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 (non-flash)
Nov 10 21:54:42 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 (non-flash)
Nov 10 21:54:42 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fda86e9-4fb4-4254-9ebc-53348573cc03]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:54:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:43 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:54:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YlzVagCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:54:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:54:43 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23734383938393632', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:54:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734383938393632', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:54:43 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lazy-loading 'flavor' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:54:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:54:43 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:54:43 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:54:43 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:54:43 user nova-compute[75285]:   <serial>9aaa6157-02f2-41e6-bc67-eebf80ec88c8</serial>
Nov 10 21:54:43 user nova-compute[75285]: </disk>
Nov 10 21:54:43 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:54:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:54:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:54:43 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] No VIF found with MAC fa:16:3e:a2:9e:1b, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:54:43 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c53e1b26-ba26-4057-9d4a-036fb566cf83 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.841s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:54:44 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:54:44 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances with incomplete migration  {{(pid=75285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 21:54:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:54:46 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:54:46 user nova-compute[75285]: INFO nova.compute.manager [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Detaching volume 9aaa6157-02f2-41e6-bc67-eebf80ec88c8
Nov 10 21:54:46 user nova-compute[75285]: INFO nova.virt.block_device [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Attempting to driver detach volume 9aaa6157-02f2-41e6-bc67-eebf80ec88c8 from mountpoint /dev/vdb
Nov 10 21:54:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Attempting to detach device vdb from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:54:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:54:46 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:54:46 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:54:46 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:54:46 user nova-compute[75285]:   <serial>9aaa6157-02f2-41e6-bc67-eebf80ec88c8</serial>
Nov 10 21:54:46 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:54:46 user nova-compute[75285]: </disk>
Nov 10 21:54:46 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:54:46 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Successfully detached device vdb from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the persistent domain config.
Nov 10 21:54:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:54:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:54:46 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:54:46 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:54:46 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:54:46 user nova-compute[75285]:   <serial>9aaa6157-02f2-41e6-bc67-eebf80ec88c8</serial>
Nov 10 21:54:46 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:54:46 user nova-compute[75285]: </disk>
Nov 10 21:54:46 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:54:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:54:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:54:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:54:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:54:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:54:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:54:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:55:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:55:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:55:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:55:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:55:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:06 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 is timed out.
Nov 10 21:55:06 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Successfully detached device vdb from instance 4883d7cc-ee48-42d6-aecc-82e68f203441 from the live domain config.
Nov 10 21:55:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YlzVagCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:55:06 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0ee69b-7f94-4454-8424-8a317617126a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:55:06 user nova-compute[75285]: No targets found.
Nov 10 21:55:06 user nova-compute[75285]: iSNS:
Nov 10 21:55:06 user nova-compute[75285]: No targets found.
Nov 10 21:55:06 user nova-compute[75285]: STATIC:
Nov 10 21:55:06 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8
Nov 10 21:55:06 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:55:06 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:55:06 user nova-compute[75285]: FIRMWARE:
Nov 10 21:55:06 user nova-compute[75285]: No targets found.
Nov 10 21:55:06 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:55:06 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:55:06 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a7aff4-d9ff-4957-bb09-793840d5ec80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cf1f65-0384-4256-bde4-e3573441915b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 (non-flash)
Nov 10 21:55:06 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 (non-flash)
Nov 10 21:55:06 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49e46d76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d4e343-d7f7-4044-b8d4-cd32cf902d2d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ce9dc2-1fc4-4ed9-8232-4b3386fc95d1]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0524b591-0ef0-4fd4-927e-69294c1c43d0]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[588d59ad-5d46-4975-b478-808064034cfe]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e114139-2bf1-4d19-98e8-981281726b6c]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7393d607-0f92-44d2-b8c2-e6aa912f23ee]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8, portal: 172.16.0.220,3260]
Nov 10 21:55:06 user nova-compute[75285]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8, portal: 172.16.0.220,3260] successful.
Nov 10 21:55:06 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9aaa6157-02f2-41e6-bc67-eebf80ec88c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7e4e90-399c-4198-877d-1b0c9dd7fd0b]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] <== disconnect_volume: return (300ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:55:06 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:55:07 user nova-compute[75285]: DEBUG nova.objects.instance [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lazy-loading 'flavor' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:55:07 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-198cfbb4-02bf-4032-97b9-64add699bb05 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.896s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:55:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:55:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:55:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:55:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:55:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:55:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:55:14 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:55:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:55:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:55:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:55:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:55:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:19 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:55:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:55:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:55:19 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:55:19 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:55:20 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updating instance_info_cache with network_info: [{"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:55:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:55:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:55:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:55:22 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:55:22 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:55:22 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:55:22 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:55:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:55:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:55:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:55:22 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:55:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:23 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:55:23 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:55:23 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8880MB free_disk=24.842166900634766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:55:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:55:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:55:23 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 4883d7cc-ee48-42d6-aecc-82e68f203441 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:55:23 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c4e906e8-15da-44c3-ac2a-d4b71dd28cad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:55:23 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:55:23 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:55:23 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:55:24 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:55:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:55:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:55:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:55:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:55:32 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:55:32 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:55:32 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:55:33 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:55:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:55:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:55:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:55:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:55:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:55:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:55:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:55:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:55:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:55:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:55:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:55:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:55:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:55:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:55:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:55:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:55:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'flavor' on Instance uuid c4e906e8-15da-44c3-ac2a-d4b71dd28cad {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:55:59 user nova-compute[75285]: INFO nova.compute.manager [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Attaching volume bf657e51-43fc-47b4-bfcf-206de3cbe34c to /dev/vdb
Nov 10 21:55:59 user nova-compute[75285]: DEBUG os_brick.utils [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfff3fc-8c0a-40d8-8de3-8b032e04d5fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c855b9576a1\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce4e786-d5b6-4338-99d5-974240787d43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac769f7-3ff7-44b8-a8e8-b072ffb0b666]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3709f548-75df-4813-a373-a40356e54f7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:55:59 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Running cmd (subprocess): nvme version {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] 'nvme version' failed. Not Retrying. {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] nvme not present on system {{(pid=75285) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 21:56:00 user nova-compute[75285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 21:56:00 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6924393-6960-4139-b3c0-5c095852821e]: (4, '') {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75285) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.lightos [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] LIGHTOS: no hostnqn found. {{(pid=75285) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG os_brick.utils [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c855b9576a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG nova.virt.block_device [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updating existing volume attachment record: 559f8bbf-5dac-414a-93cb-fa8b57ceb3a6 {{(pid=75285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:56:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:56:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:56:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:56:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:56:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:56:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:15 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:56:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:56:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:56:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:56:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:56:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:16 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:56:20 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:56:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:56:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:56:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:56:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:56:20 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:56:20 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:56:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:56:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:56:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:56:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:56:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:21 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updating instance_info_cache with network_info: [{"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:56:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-4883d7cc-ee48-42d6-aecc-82e68f203441" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:56:21 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:56:22 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:56:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:56:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:56:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:56:22 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:56:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:22 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Calling os-brick to attach iSCSI Volume {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yKxQnHvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:56:23 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:56:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:56:23 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:56:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:56:23 user nova-compute[75285]: INFO os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 21:56:23 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:56:23 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:56:23 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8892MB free_disk=24.840953826904297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac01633-28a2-4b46-bd85-6734dba13d06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 21:56:23 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --interface default --op new {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b0726f-a6c5-451e-a9fb-453c98cfed3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c] added\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c] added
Nov 10 21:56:23 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf996c3-db21-419f-a937-1619ed3403f8]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:56:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance 4883d7cc-ee48-42d6-aecc-82e68f203441 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c4e906e8-15da-44c3-ac2a-d4b71dd28cad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6792d87-51c2-4832-875f-5b35585b52fb]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yKxQnHvZ {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yKxQnHvZ" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8965ad8-0e3e-42c0-82bf-69daa23af4f9]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yKxQnHvZ'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c8d088-e257-431f-a5aa-4145ad3b0980]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ec464d-4a84-48ed-9229-16cab61950bf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:56:24 user nova-compute[75285]:  {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 21:56:24 user nova-compute[75285]:  {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:56:24 user nova-compute[75285]: WARNING os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 21:56:24 user nova-compute[75285]: 
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --login {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffe6ec0-11e8-4ac1-bf28-23e4f9244a37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c, portal: 172.16.0.220,3260]
Nov 10 21:56:24 user nova-compute[75285]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c, portal: 172.16.0.220,3260] successful.
Nov 10 21:56:24 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b5ae5f-5aed-4661-be75-07603aeb6485]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f87faf4-0c39-4f16-a468-ff928fe389b7]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c (non-flash)
Nov 10 21:56:24 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c (non-flash)
Nov 10 21:56:24 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Connected to 172.16.0.220:3260 {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75285) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75285) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d36a15-f5c1-4dad-96ad-85a6486e5563]: (4, ('- - 0', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75285) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 21:56:24 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yKxQnHvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75285) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23231616334373266', 'path': '/dev/sdb'} {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231616334373266', 'path': '/dev/sdb'} {{(pid=75285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG nova.objects.instance [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'flavor' on Instance uuid c4e906e8-15da-44c3-ac2a-d4b71dd28cad {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 21:56:25 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:56:25 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:56:25 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:56:25 user nova-compute[75285]:   <serial>bf657e51-43fc-47b4-bfcf-206de3cbe34c</serial>
Nov 10 21:56:25 user nova-compute[75285]: </disk>
Nov 10 21:56:25 user nova-compute[75285]:  {{(pid=75285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] No BDM found with device name vda, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] No VIF found with MAC fa:16:3e:78:28:bb, not building metadata {{(pid=75285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-c7756a84-518e-4cc5-8f30-2f63b89e708f tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.959s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:56:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:26 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:56:26 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:56:26 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:56:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-ea697b3c-30df-4718-9e8c-277c522aa126 req-409b69cd-fe6a-43d1-9a89-2c5fada17bbe service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-changed-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:56:28 user nova-compute[75285]: DEBUG nova.compute.manager [req-ea697b3c-30df-4718-9e8c-277c522aa126 req-409b69cd-fe6a-43d1-9a89-2c5fada17bbe service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Refreshing instance network info cache due to event network-changed-5271ced0-40fa-45d5-a118-44866a5b29a0. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:56:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ea697b3c-30df-4718-9e8c-277c522aa126 req-409b69cd-fe6a-43d1-9a89-2c5fada17bbe service nova] Acquiring lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:56:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ea697b3c-30df-4718-9e8c-277c522aa126 req-409b69cd-fe6a-43d1-9a89-2c5fada17bbe service nova] Acquired lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:56:28 user nova-compute[75285]: DEBUG nova.network.neutron [req-ea697b3c-30df-4718-9e8c-277c522aa126 req-409b69cd-fe6a-43d1-9a89-2c5fada17bbe service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Refreshing network info cache for port 5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:56:29 user nova-compute[75285]: DEBUG nova.network.neutron [req-ea697b3c-30df-4718-9e8c-277c522aa126 req-409b69cd-fe6a-43d1-9a89-2c5fada17bbe service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updated VIF entry in instance network info cache for port 5271ced0-40fa-45d5-a118-44866a5b29a0. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:56:29 user nova-compute[75285]: DEBUG nova.network.neutron [req-ea697b3c-30df-4718-9e8c-277c522aa126 req-409b69cd-fe6a-43d1-9a89-2c5fada17bbe service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updating instance_info_cache with network_info: [{"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:56:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-ea697b3c-30df-4718-9e8c-277c522aa126 req-409b69cd-fe6a-43d1-9a89-2c5fada17bbe service nova] Releasing lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:56:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:31 user nova-compute[75285]: DEBUG nova.compute.manager [req-e623de8b-0edd-470d-9640-83e5f572aa6f req-9ffc24d9-76bf-430e-bcf6-86ccbd8e5af1 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-changed-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:56:31 user nova-compute[75285]: DEBUG nova.compute.manager [req-e623de8b-0edd-470d-9640-83e5f572aa6f req-9ffc24d9-76bf-430e-bcf6-86ccbd8e5af1 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Refreshing instance network info cache due to event network-changed-5271ced0-40fa-45d5-a118-44866a5b29a0. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:56:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e623de8b-0edd-470d-9640-83e5f572aa6f req-9ffc24d9-76bf-430e-bcf6-86ccbd8e5af1 service nova] Acquiring lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:56:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e623de8b-0edd-470d-9640-83e5f572aa6f req-9ffc24d9-76bf-430e-bcf6-86ccbd8e5af1 service nova] Acquired lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:56:31 user nova-compute[75285]: DEBUG nova.network.neutron [req-e623de8b-0edd-470d-9640-83e5f572aa6f req-9ffc24d9-76bf-430e-bcf6-86ccbd8e5af1 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Refreshing network info cache for port 5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:56:31 user nova-compute[75285]: DEBUG nova.network.neutron [req-e623de8b-0edd-470d-9640-83e5f572aa6f req-9ffc24d9-76bf-430e-bcf6-86ccbd8e5af1 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updated VIF entry in instance network info cache for port 5271ced0-40fa-45d5-a118-44866a5b29a0. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:56:31 user nova-compute[75285]: DEBUG nova.network.neutron [req-e623de8b-0edd-470d-9640-83e5f572aa6f req-9ffc24d9-76bf-430e-bcf6-86ccbd8e5af1 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updating instance_info_cache with network_info: [{"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:56:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-e623de8b-0edd-470d-9640-83e5f572aa6f req-9ffc24d9-76bf-430e-bcf6-86ccbd8e5af1 service nova] Releasing lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:56:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-01b24710-bc87-4974-b6ec-6e1069798e43 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:56:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-01b24710-bc87-4974-b6ec-6e1069798e43 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:56:31 user nova-compute[75285]: INFO nova.compute.manager [None req-01b24710-bc87-4974-b6ec-6e1069798e43 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Rebooting instance
Nov 10 21:56:31 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:56:31 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:56:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-01b24710-bc87-4974-b6ec-6e1069798e43 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:56:31 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-01b24710-bc87-4974-b6ec-6e1069798e43 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquired lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:56:31 user nova-compute[75285]: DEBUG nova.network.neutron [None req-01b24710-bc87-4974-b6ec-6e1069798e43 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Building network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 21:56:32 user nova-compute[75285]: DEBUG nova.network.neutron [None req-01b24710-bc87-4974-b6ec-6e1069798e43 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updating instance_info_cache with network_info: [{"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:56:32 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-01b24710-bc87-4974-b6ec-6e1069798e43 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Releasing lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:56:32 user nova-compute[75285]: DEBUG nova.compute.manager [None req-01b24710-bc87-4974-b6ec-6e1069798e43 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:56:32 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:32 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:56:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:34 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-7ce9bd6b-86c5-4cfc-84be-0c1021f353da req-60699a37-f85f-4d8f-aba2-5dac01edf79e service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-vif-unplugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:56:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7ce9bd6b-86c5-4cfc-84be-0c1021f353da req-60699a37-f85f-4d8f-aba2-5dac01edf79e service nova] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:56:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7ce9bd6b-86c5-4cfc-84be-0c1021f353da req-60699a37-f85f-4d8f-aba2-5dac01edf79e service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:56:34 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-7ce9bd6b-86c5-4cfc-84be-0c1021f353da req-60699a37-f85f-4d8f-aba2-5dac01edf79e service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:56:34 user nova-compute[75285]: DEBUG nova.compute.manager [req-7ce9bd6b-86c5-4cfc-84be-0c1021f353da req-60699a37-f85f-4d8f-aba2-5dac01edf79e service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] No waiting events found dispatching network-vif-unplugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:56:34 user nova-compute[75285]: WARNING nova.compute.manager [req-7ce9bd6b-86c5-4cfc-84be-0c1021f353da req-60699a37-f85f-4d8f-aba2-5dac01edf79e service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received unexpected event network-vif-unplugged-5271ced0-40fa-45d5-a118-44866a5b29a0 for instance with vm_state active and task_state reboot_started.
Nov 10 21:56:35 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-01b24710-bc87-4974-b6ec-6e1069798e43 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Instance shutdown successfully.
Nov 10 21:56:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:36 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-614410f6-3502-4c31-b962-4e99fc6a8372 req-66dfb336-2d76-4a19-8692-39a5a5fb84ab service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:56:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-614410f6-3502-4c31-b962-4e99fc6a8372 req-66dfb336-2d76-4a19-8692-39a5a5fb84ab service nova] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:56:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-614410f6-3502-4c31-b962-4e99fc6a8372 req-66dfb336-2d76-4a19-8692-39a5a5fb84ab service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:56:36 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-614410f6-3502-4c31-b962-4e99fc6a8372 req-66dfb336-2d76-4a19-8692-39a5a5fb84ab service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:56:36 user nova-compute[75285]: DEBUG nova.compute.manager [req-614410f6-3502-4c31-b962-4e99fc6a8372 req-66dfb336-2d76-4a19-8692-39a5a5fb84ab service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] No waiting events found dispatching network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:56:36 user nova-compute[75285]: WARNING nova.compute.manager [req-614410f6-3502-4c31-b962-4e99fc6a8372 req-66dfb336-2d76-4a19-8692-39a5a5fb84ab service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received unexpected event network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 for instance with vm_state active and task_state reboot_started.
Nov 10 21:56:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:37 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:38 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Instance running successfully.
Nov 10 21:56:38 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-01b24710-bc87-4974-b6ec-6e1069798e43 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Instance soft rebooted successfully.
Nov 10 21:56:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-01b24710-bc87-4974-b6ec-6e1069798e43 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Checking state {{(pid=75285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 21:56:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-5aa981d5-6df1-4b8d-86f3-e2bd4410c4b5 req-cfebdf64-d944-4981-9042-5e751337c546 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:56:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5aa981d5-6df1-4b8d-86f3-e2bd4410c4b5 req-cfebdf64-d944-4981-9042-5e751337c546 service nova] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:56:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5aa981d5-6df1-4b8d-86f3-e2bd4410c4b5 req-cfebdf64-d944-4981-9042-5e751337c546 service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:56:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5aa981d5-6df1-4b8d-86f3-e2bd4410c4b5 req-cfebdf64-d944-4981-9042-5e751337c546 service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:56:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-5aa981d5-6df1-4b8d-86f3-e2bd4410c4b5 req-cfebdf64-d944-4981-9042-5e751337c546 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] No waiting events found dispatching network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:56:38 user nova-compute[75285]: WARNING nova.compute.manager [req-5aa981d5-6df1-4b8d-86f3-e2bd4410c4b5 req-cfebdf64-d944-4981-9042-5e751337c546 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received unexpected event network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 for instance with vm_state active and task_state reboot_started.
Nov 10 21:56:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-5aa981d5-6df1-4b8d-86f3-e2bd4410c4b5 req-cfebdf64-d944-4981-9042-5e751337c546 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:56:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5aa981d5-6df1-4b8d-86f3-e2bd4410c4b5 req-cfebdf64-d944-4981-9042-5e751337c546 service nova] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:56:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5aa981d5-6df1-4b8d-86f3-e2bd4410c4b5 req-cfebdf64-d944-4981-9042-5e751337c546 service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:56:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-5aa981d5-6df1-4b8d-86f3-e2bd4410c4b5 req-cfebdf64-d944-4981-9042-5e751337c546 service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:56:38 user nova-compute[75285]: DEBUG nova.compute.manager [req-5aa981d5-6df1-4b8d-86f3-e2bd4410c4b5 req-cfebdf64-d944-4981-9042-5e751337c546 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] No waiting events found dispatching network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:56:38 user nova-compute[75285]: WARNING nova.compute.manager [req-5aa981d5-6df1-4b8d-86f3-e2bd4410c4b5 req-cfebdf64-d944-4981-9042-5e751337c546 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received unexpected event network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 for instance with vm_state active and task_state reboot_started.
Nov 10 21:56:38 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-01b24710-bc87-4974-b6ec-6e1069798e43 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.139s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:56:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:42 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:47 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:52 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:57 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:56:59 user nova-compute[75285]: INFO nova.compute.manager [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Terminating instance
Nov 10 21:56:59 user nova-compute[75285]: DEBUG nova.compute.manager [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-358c3c8c-3ebd-4d4c-8919-c59336fe29bb req-05dd344b-b198-4cd8-8872-2de5b86e82a3 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Received event network-vif-unplugged-32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-358c3c8c-3ebd-4d4c-8919-c59336fe29bb req-05dd344b-b198-4cd8-8872-2de5b86e82a3 service nova] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-358c3c8c-3ebd-4d4c-8919-c59336fe29bb req-05dd344b-b198-4cd8-8872-2de5b86e82a3 service nova] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-358c3c8c-3ebd-4d4c-8919-c59336fe29bb req-05dd344b-b198-4cd8-8872-2de5b86e82a3 service nova] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-358c3c8c-3ebd-4d4c-8919-c59336fe29bb req-05dd344b-b198-4cd8-8872-2de5b86e82a3 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] No waiting events found dispatching network-vif-unplugged-32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:56:59 user nova-compute[75285]: DEBUG nova.compute.manager [req-358c3c8c-3ebd-4d4c-8919-c59336fe29bb req-05dd344b-b198-4cd8-8872-2de5b86e82a3 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Received event network-vif-unplugged-32da4b81-4b9a-4ee3-acc5-77ded90023f7 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:57:00 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Instance destroyed successfully.
Nov 10 21:57:00 user nova-compute[75285]: DEBUG nova.objects.instance [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lazy-loading 'resources' on Instance uuid 4883d7cc-ee48-42d6-aecc-82e68f203441 {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1336114405',display_name='tempest-SnapshotDataIntegrityTests-server-1336114405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1336114405',id=49,image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoy9QjyuQX+M6Ro2B0S0PjJ8VtpDfUT1wvflgqy0O0Zp71HP0DkeaH46+KZ8qUof6SA1KAhCr5XG+Cgm549brvvmxwwPiXKbM6SsupnQ1p59QY05gwZ6F6/RgBMfvalrA==',key_name='tempest-keypair-428784909',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:47:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f13cd60442854c50b825af9e6f70d18e',ramdisk_id='',reservation_id='r-vpkhgpbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e00023c7-f7f3-49f2-b464-c809b7ab7608',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2111065423',owner_user_name='tempest-SnapshotDataIntegrityTests-2111065423-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7785cf2c3a6046cda94bba0bc3d9301d',uuid=4883d7cc-ee48-42d6-aecc-82e68f203441,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Converting VIF {"id": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "address": "fa:16:3e:a2:9e:1b", "network": {"id": "d863da2d-c5de-41fc-92e4-a6a6ae46c7f4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-368032354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f13cd60442854c50b825af9e6f70d18e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32da4b81-4b", "ovs_interfaceid": "32da4b81-4b9a-4ee3-acc5-77ded90023f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:9e:1b,bridge_name='br-int',has_traffic_filtering=True,id=32da4b81-4b9a-4ee3-acc5-77ded90023f7,network=Network(d863da2d-c5de-41fc-92e4-a6a6ae46c7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32da4b81-4b') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG os_vif [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:9e:1b,bridge_name='br-int',has_traffic_filtering=True,id=32da4b81-4b9a-4ee3-acc5-77ded90023f7,network=Network(d863da2d-c5de-41fc-92e4-a6a6ae46c7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32da4b81-4b') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32da4b81-4b, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=305301e1-f7d7-485e-912e-f0c9ccc66304) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:57:00 user nova-compute[75285]: INFO os_vif [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:9e:1b,bridge_name='br-int',has_traffic_filtering=True,id=32da4b81-4b9a-4ee3-acc5-77ded90023f7,network=Network(d863da2d-c5de-41fc-92e4-a6a6ae46c7f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32da4b81-4b')
Nov 10 21:57:00 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Deleting instance files /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441_del
Nov 10 21:57:00 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Deletion of /opt/stack/data/nova/instances/4883d7cc-ee48-42d6-aecc-82e68f203441_del complete
Nov 10 21:57:00 user nova-compute[75285]: INFO nova.compute.manager [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 10 21:57:00 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:57:00 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:57:01 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Took 0.70 seconds to deallocate network for instance.
Nov 10 21:57:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:57:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:57:01 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:57:01 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:57:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:57:01 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Deleted allocations for instance 4883d7cc-ee48-42d6-aecc-82e68f203441
Nov 10 21:57:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-ed07ea40-0e98-4af3-9480-4843414ba9d5 tempest-SnapshotDataIntegrityTests-2111065423 tempest-SnapshotDataIntegrityTests-2111065423-project-member] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.143s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:57:01 user nova-compute[75285]: DEBUG nova.compute.manager [req-6d384d33-9b8c-4d2c-a06f-efabe72fd108 req-0324b085-d2d2-43e8-9267-7cd352939655 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Received event network-vif-plugged-32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:57:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6d384d33-9b8c-4d2c-a06f-efabe72fd108 req-0324b085-d2d2-43e8-9267-7cd352939655 service nova] Acquiring lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:57:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6d384d33-9b8c-4d2c-a06f-efabe72fd108 req-0324b085-d2d2-43e8-9267-7cd352939655 service nova] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:57:01 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-6d384d33-9b8c-4d2c-a06f-efabe72fd108 req-0324b085-d2d2-43e8-9267-7cd352939655 service nova] Lock "4883d7cc-ee48-42d6-aecc-82e68f203441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:57:01 user nova-compute[75285]: DEBUG nova.compute.manager [req-6d384d33-9b8c-4d2c-a06f-efabe72fd108 req-0324b085-d2d2-43e8-9267-7cd352939655 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] No waiting events found dispatching network-vif-plugged-32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:57:01 user nova-compute[75285]: WARNING nova.compute.manager [req-6d384d33-9b8c-4d2c-a06f-efabe72fd108 req-0324b085-d2d2-43e8-9267-7cd352939655 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Received unexpected event network-vif-plugged-32da4b81-4b9a-4ee3-acc5-77ded90023f7 for instance with vm_state deleted and task_state None.
Nov 10 21:57:01 user nova-compute[75285]: DEBUG nova.compute.manager [req-6d384d33-9b8c-4d2c-a06f-efabe72fd108 req-0324b085-d2d2-43e8-9267-7cd352939655 service nova] [instance: 4883d7cc-ee48-42d6-aecc-82e68f203441] Received event network-vif-deleted-32da4b81-4b9a-4ee3-acc5-77ded90023f7 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:57:02 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:07 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:57:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:57:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:57:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:57:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:16 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:57:18 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:57:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:20 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:57:20 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:57:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:57:20 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:57:20 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:57:21 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updating instance_info_cache with network_info: [{"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:57:21 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:57:21 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:57:23 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:57:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:57:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:57:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:57:23 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:57:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:57:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:57:23 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:57:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:57:24 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:57:24 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:57:24 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:57:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=8956MB free_disk=24.866859436035156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:57:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:57:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:57:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c4e906e8-15da-44c3-ac2a-d4b71dd28cad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:57:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:57:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:57:24 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:57:24 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:57:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:57:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:57:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:57:25 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:57:25 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:57:25 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:57:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:57:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:57:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:57:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:57:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:33 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:57:33 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:57:33 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:57:34 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:57:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:57:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:57:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:57:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:57:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:57:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:58:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:58:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:58:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:58:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:58:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:58:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:58:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:58:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:58:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:58:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:58:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:58:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:58:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:58:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:58:18 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:58:19 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:58:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:58:22 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:58:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:58:22 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:58:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:58:22 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:58:22 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:58:22 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid c4e906e8-15da-44c3-ac2a-d4b71dd28cad {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:58:23 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updating instance_info_cache with network_info: [{"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:58:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:58:23 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-61064263-bb8d-4798-9196-3a33b0255a43 req-b5b46959-1ff1-4f76-bf62-78d6fae207dc service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-changed-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-61064263-bb8d-4798-9196-3a33b0255a43 req-b5b46959-1ff1-4f76-bf62-78d6fae207dc service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Refreshing instance network info cache due to event network-changed-5271ced0-40fa-45d5-a118-44866a5b29a0. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-61064263-bb8d-4798-9196-3a33b0255a43 req-b5b46959-1ff1-4f76-bf62-78d6fae207dc service nova] Acquiring lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-61064263-bb8d-4798-9196-3a33b0255a43 req-b5b46959-1ff1-4f76-bf62-78d6fae207dc service nova] Acquired lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG nova.network.neutron [req-61064263-bb8d-4798-9196-3a33b0255a43 req-b5b46959-1ff1-4f76-bf62-78d6fae207dc service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Refreshing network info cache for port 5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG nova.network.neutron [req-61064263-bb8d-4798-9196-3a33b0255a43 req-b5b46959-1ff1-4f76-bf62-78d6fae207dc service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updated VIF entry in instance network info cache for port 5271ced0-40fa-45d5-a118-44866a5b29a0. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG nova.network.neutron [req-61064263-bb8d-4798-9196-3a33b0255a43 req-b5b46959-1ff1-4f76-bf62-78d6fae207dc service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updating instance_info_cache with network_info: [{"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-61064263-bb8d-4798-9196-3a33b0255a43 req-b5b46959-1ff1-4f76-bf62-78d6fae207dc service nova] Releasing lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-65524edc-597e-4682-8be7-32d345c0a58c req-0521465c-789b-40bf-9b7b-085d1342c467 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-changed-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG nova.compute.manager [req-65524edc-597e-4682-8be7-32d345c0a58c req-0521465c-789b-40bf-9b7b-085d1342c467 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Refreshing instance network info cache due to event network-changed-5271ced0-40fa-45d5-a118-44866a5b29a0. {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-65524edc-597e-4682-8be7-32d345c0a58c req-0521465c-789b-40bf-9b7b-085d1342c467 service nova] Acquiring lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-65524edc-597e-4682-8be7-32d345c0a58c req-0521465c-789b-40bf-9b7b-085d1342c467 service nova] Acquired lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG nova.network.neutron [req-65524edc-597e-4682-8be7-32d345c0a58c req-0521465c-789b-40bf-9b7b-085d1342c467 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Refreshing network info cache for port 5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:58:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:58:25 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:58:25 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=9045MB free_disk=24.865188598632812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:58:25 user nova-compute[75285]: INFO nova.compute.manager [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Detaching volume bf657e51-43fc-47b4-bfcf-206de3cbe34c
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c4e906e8-15da-44c3-ac2a-d4b71dd28cad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:58:25 user nova-compute[75285]: INFO nova.virt.block_device [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Attempting to driver detach volume bf657e51-43fc-47b4-bfcf-206de3cbe34c from mountpoint /dev/vdb
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Attempting to detach device vdb from instance c4e906e8-15da-44c3-ac2a-d4b71dd28cad from the persistent domain config. {{(pid=75285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:58:25 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:58:25 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:58:25 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:58:25 user nova-compute[75285]:   <serial>bf657e51-43fc-47b4-bfcf-206de3cbe34c</serial>
Nov 10 21:58:25 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:58:25 user nova-compute[75285]: </disk>
Nov 10 21:58:25 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:58:25 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Successfully detached device vdb from instance c4e906e8-15da-44c3-ac2a-d4b71dd28cad from the persistent domain config.
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c4e906e8-15da-44c3-ac2a-d4b71dd28cad from the live domain config. {{(pid=75285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.guest [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 21:58:25 user nova-compute[75285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 21:58:25 user nova-compute[75285]:   <source dev="/dev/sdb"/>
Nov 10 21:58:25 user nova-compute[75285]:   <target dev="vdb" bus="virtio"/>
Nov 10 21:58:25 user nova-compute[75285]:   <serial>bf657e51-43fc-47b4-bfcf-206de3cbe34c</serial>
Nov 10 21:58:25 user nova-compute[75285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 21:58:25 user nova-compute[75285]: </disk>
Nov 10 21:58:25 user nova-compute[75285]:  {{(pid=75285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.network.neutron [req-65524edc-597e-4682-8be7-32d345c0a58c req-0521465c-789b-40bf-9b7b-085d1342c467 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updated VIF entry in instance network info cache for port 5271ced0-40fa-45d5-a118-44866a5b29a0. {{(pid=75285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.network.neutron [req-65524edc-597e-4682-8be7-32d345c0a58c req-0521465c-789b-40bf-9b7b-085d1342c467 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updating instance_info_cache with network_info: [{"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-65524edc-597e-4682-8be7-32d345c0a58c req-0521465c-789b-40bf-9b7b-085d1342c467 service nova] Releasing lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:58:25 user nova-compute[75285]: DEBUG nova.virt.libvirt.driver [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c4e906e8-15da-44c3-ac2a-d4b71dd28cad {{(pid=75285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 21:58:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:58:27 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:58:27 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:58:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:58:30 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:58:34 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:58:34 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:58:35 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:58:35 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:58:40 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:58:45 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:58:45 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c4e906e8-15da-44c3-ac2a-d4b71dd28cad is timed out.
Nov 10 21:58:45 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Successfully detached device vdb from instance c4e906e8-15da-44c3-ac2a-d4b71dd28cad from the live domain config.
Nov 10 21:58:45 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] calling os-brick to detach iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 21:58:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f49fc3d55a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yKxQnHvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 21:58:45 user nova-compute[75285]: WARNING os_brick.initiator.connectors.base [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 21:58:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 21:58:45 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 21:58:45 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dfa425-3762-4ce1-80b0-fa8f244bcf0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 21:58:46 user nova-compute[75285]: No targets found.
Nov 10 21:58:46 user nova-compute[75285]: iSNS:
Nov 10 21:58:46 user nova-compute[75285]: No targets found.
Nov 10 21:58:46 user nova-compute[75285]: STATIC:
Nov 10 21:58:46 user nova-compute[75285]: Target: iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c
Nov 10 21:58:46 user nova-compute[75285]:         Portal: 172.16.0.220:3260,-1
Nov 10 21:58:46 user nova-compute[75285]:                 Iface Name: default
Nov 10 21:58:46 user nova-compute[75285]: FIRMWARE:
Nov 10 21:58:46 user nova-compute[75285]: No targets found.
Nov 10 21:58:46 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 21:58:46 user nova-compute[75285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 21:58:46 user nova-compute[75285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75285) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c', 0)] {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[658cd6c6-42fe-43aa-824b-2f82206e4dbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbf4779-fedf-433a-b56d-461ae145926e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c (non-flash)\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c (non-flash)
Nov 10 21:58:46 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c (non-flash)
Nov 10 21:58:46 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f49fc353010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c'): ({'sdb'}, set())}) {{(pid=75285) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Removing single pathed devices sdb {{(pid=75285) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a031237-b61c-4327-893b-61ebce152831]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9ad464-37c5-4a66-8597-bbbd1fabe2b6]: (4, ('ok\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Flushing IO for device /dev/sdb {{(pid=75285) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e97243-d082-4c65-979e-afb04f8ef345]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75285) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c87105-eb30-417f-91dc-7cf2ce5752ed]: (4, ('1', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.linuxscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] SCSI volumes sdb have been removed. {{(pid=75285) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c')] {{(pid=75285) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[59007b00-2fff-415e-b986-e32aff3c172c]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --logout {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1172af7f-7429-4a20-9631-d0f56c1652c2]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c, portal: 172.16.0.220,3260]
Nov 10 21:58:46 user nova-compute[75285]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c, portal: 172.16.0.220,3260] successful.
Nov 10 21:58:46 user nova-compute[75285]:  stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --op delete {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf657e51-43fc-47b4-bfcf-206de3cbe34c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86427) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bd06b6-f3f2-4143-b178-a45b9509cdaf]: (4, ('', '')) {{(pid=86427) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75285) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.base [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG os_brick.initiator.connectors.iscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] <== disconnect_volume: return (279ms) None {{(pid=75285) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 21:58:46 user nova-compute[75285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Disconnected iSCSI Volume {{(pid=75285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 21:58:47 user nova-compute[75285]: DEBUG nova.objects.instance [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'flavor' on Instance uuid c4e906e8-15da-44c3-ac2a-d4b71dd28cad {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:58:47 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-394014cd-b7b7-4c95-9e0b-9634b265209b tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.766s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:58:50 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:58:55 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:00 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:05 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:59:09 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:59:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:59:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:59:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:59:10 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:15 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:19 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:19 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 21:59:19 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] There are 0 instances to clean {{(pid=75285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 21:59:20 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:59:20 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:23 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:23 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 21:59:23 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 21:59:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 21:59:23 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquired lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 21:59:23 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Forcefully refreshing network info cache for instance {{(pid=75285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 21:59:23 user nova-compute[75285]: DEBUG nova.objects.instance [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lazy-loading 'info_cache' on Instance uuid c4e906e8-15da-44c3-ac2a-d4b71dd28cad {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:59:24 user nova-compute[75285]: DEBUG nova.network.neutron [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updating instance_info_cache with network_info: [{"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:59:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Releasing lock "refresh_cache-c4e906e8-15da-44c3-ac2a-d4b71dd28cad" {{(pid=75285) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 21:59:24 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updated the network info_cache for instance {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 21:59:24 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:59:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:59:24 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:59:24 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 21:59:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:59:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:59:24 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG oslo_concurrency.processutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75285) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 21:59:25 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:59:25 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 21:59:25 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=9054MB free_disk=24.864429473876953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Instance c4e906e8-15da-44c3-ac2a-d4b71dd28cad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing inventories for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating ProviderTree inventory for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Updating inventory in ProviderTree for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing aggregate associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, aggregates: None {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Refreshing trait associations for resource provider ec9ffc90-0859-4ab9-a65f-7415028d9d13, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO {{(pid=75285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 21:59:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:59:27 user nova-compute[75285]: INFO nova.compute.manager [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Terminating instance
Nov 10 21:59:27 user nova-compute[75285]: DEBUG nova.compute.manager [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Start destroying the instance on the hypervisor. {{(pid=75285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-c71e6a67-207b-42b3-b7f5-bd090f4ae670 req-96d390f7-452e-47e8-bfb8-a3b5d75e7916 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-vif-unplugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c71e6a67-207b-42b3-b7f5-bd090f4ae670 req-96d390f7-452e-47e8-bfb8-a3b5d75e7916 service nova] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c71e6a67-207b-42b3-b7f5-bd090f4ae670 req-96d390f7-452e-47e8-bfb8-a3b5d75e7916 service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-c71e6a67-207b-42b3-b7f5-bd090f4ae670 req-96d390f7-452e-47e8-bfb8-a3b5d75e7916 service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-c71e6a67-207b-42b3-b7f5-bd090f4ae670 req-96d390f7-452e-47e8-bfb8-a3b5d75e7916 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] No waiting events found dispatching network-vif-unplugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG nova.compute.manager [req-c71e6a67-207b-42b3-b7f5-bd090f4ae670 req-96d390f7-452e-47e8-bfb8-a3b5d75e7916 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-vif-unplugged-5271ced0-40fa-45d5-a118-44866a5b29a0 for instance with task_state deleting. {{(pid=75285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 21:59:27 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:28 user nova-compute[75285]: INFO nova.virt.libvirt.driver [-] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Instance destroyed successfully.
Nov 10 21:59:28 user nova-compute[75285]: DEBUG nova.objects.instance [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lazy-loading 'resources' on Instance uuid c4e906e8-15da-44c3-ac2a-d4b71dd28cad {{(pid=75285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG nova.virt.libvirt.vif [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T21:54:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-603890020',display_name='tempest-TestMinimumBasicScenario-server-603890020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-603890020',id=50,image_ref='a68dd8bc-e8ff-41f7-bdef-f56b1548a7c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCT1qfvuqQyGq9zfvnOxO4HBhGlLPkuHXPrXeoElBRy8l2Y2wn8+CUdcAqYSi2XRd+7SGqTi2cARQGIynUW/tlsD+xAY+yotDxyzQNZutQCQxnBZoSD5Rn3493B8Lyq96A==',key_name='tempest-TestMinimumBasicScenario-1980357873',keypairs=<?>,launch_index=0,launched_at=2023-11-10T21:54:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5be8bdaa0904649a3942a800ab22520',ramdisk_id='',reservation_id='r-60ldg1mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a68dd8bc-e8ff-41f7-bdef-f56b1548a7c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546154678',owner_user_name='tempest-TestMinimumBasicScenario-546154678-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T21:56:39Z,user_data=None,user_id='face290806c0494b956c6574c086fda8',uuid=c4e906e8-15da-44c3-ac2a-d4b71dd28cad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converting VIF {"id": "5271ced0-40fa-45d5-a118-44866a5b29a0", "address": "fa:16:3e:78:28:bb", "network": {"id": "0ec2f063-b2b6-4263-9c15-bb3fc060b7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-74816853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5be8bdaa0904649a3942a800ab22520", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5271ced0-40", "ovs_interfaceid": "5271ced0-40fa-45d5-a118-44866a5b29a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG nova.network.os_vif_util [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:28:bb,bridge_name='br-int',has_traffic_filtering=True,id=5271ced0-40fa-45d5-a118-44866a5b29a0,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5271ced0-40') {{(pid=75285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG os_vif [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:28:bb,bridge_name='br-int',has_traffic_filtering=True,id=5271ced0-40fa-45d5-a118-44866a5b29a0,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5271ced0-40') {{(pid=75285) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5271ced0-40, bridge=br-int, if_exists=True) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29ea25b0-a74f-4247-b9d9-24f1e61c95c2) {{(pid=75285) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:59:28 user nova-compute[75285]: INFO os_vif [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:28:bb,bridge_name='br-int',has_traffic_filtering=True,id=5271ced0-40fa-45d5-a118-44866a5b29a0,network=Network(0ec2f063-b2b6-4263-9c15-bb3fc060b7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5271ced0-40')
Nov 10 21:59:28 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Deleting instance files /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad_del
Nov 10 21:59:28 user nova-compute[75285]: INFO nova.virt.libvirt.driver [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Deletion of /opt/stack/data/nova/instances/c4e906e8-15da-44c3-ac2a-d4b71dd28cad_del complete
Nov 10 21:59:28 user nova-compute[75285]: INFO nova.compute.manager [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 10 21:59:28 user nova-compute[75285]: DEBUG oslo.service.loopingcall [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75285) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG nova.compute.manager [-] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Deallocating network for instance {{(pid=75285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] deallocate_for_instance() {{(pid=75285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG nova.network.neutron [-] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Updating instance_info_cache with network_info: [] {{(pid=75285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 21:59:28 user nova-compute[75285]: INFO nova.compute.manager [-] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Took 0.57 seconds to deallocate network for instance.
Nov 10 21:59:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 21:59:28 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:59:28 user nova-compute[75285]: INFO nova.scheduler.client.report [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Deleted allocations for instance c4e906e8-15da-44c3-ac2a-d4b71dd28cad
Nov 10 21:59:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-73bd9162-4849-4c6e-9e92-d5c9fc6d1c11 tempest-TestMinimumBasicScenario-546154678 tempest-TestMinimumBasicScenario-546154678-project-member] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.756s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:59:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-bcb70d46-fd7c-4784-9a6b-cb61609933ae req-17b7743b-b8bb-4a63-a533-b8bb684db362 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:59:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bcb70d46-fd7c-4784-9a6b-cb61609933ae req-17b7743b-b8bb-4a63-a533-b8bb684db362 service nova] Acquiring lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 21:59:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bcb70d46-fd7c-4784-9a6b-cb61609933ae req-17b7743b-b8bb-4a63-a533-b8bb684db362 service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 21:59:29 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [req-bcb70d46-fd7c-4784-9a6b-cb61609933ae req-17b7743b-b8bb-4a63-a533-b8bb684db362 service nova] Lock "c4e906e8-15da-44c3-ac2a-d4b71dd28cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 21:59:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-bcb70d46-fd7c-4784-9a6b-cb61609933ae req-17b7743b-b8bb-4a63-a533-b8bb684db362 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] No waiting events found dispatching network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 21:59:29 user nova-compute[75285]: WARNING nova.compute.manager [req-bcb70d46-fd7c-4784-9a6b-cb61609933ae req-17b7743b-b8bb-4a63-a533-b8bb684db362 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received unexpected event network-vif-plugged-5271ced0-40fa-45d5-a118-44866a5b29a0 for instance with vm_state deleted and task_state None.
Nov 10 21:59:29 user nova-compute[75285]: DEBUG nova.compute.manager [req-bcb70d46-fd7c-4784-9a6b-cb61609933ae req-17b7743b-b8bb-4a63-a533-b8bb684db362 service nova] [instance: c4e906e8-15da-44c3-ac2a-d4b71dd28cad] Received event network-vif-deleted-5271ced0-40fa-45d5-a118-44866a5b29a0 {{(pid=75285) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 21:59:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:36 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:36 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:36 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:36 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 21:59:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:59:39 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._sync_power_states {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:59:44 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:59:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 21:59:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 21:59:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:59:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 21:59:53 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 21:59:54 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 21:59:54 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Cleaning up deleted instances with incomplete migration  {{(pid=75285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 21:59:58 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:00:03 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:00:08 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:00:13 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:00:18 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:00:19 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:00:20 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:00:20 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:00:21 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:00:23 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:00:24 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:00:24 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:00:24 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Starting heal instance info cache {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 22:00:24 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Rebuilding the list of instances to heal {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 22:00:24 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Didn't find any instances for network info cache update. {{(pid=75285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 22:00:25 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager.update_available_resource {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:00:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:00:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:00:25 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:00:25 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Auditing locally available compute resources for user (node: user) {{(pid=75285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 22:00:25 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:00:25 user nova-compute[75285]: WARNING nova.virt.libvirt.driver [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 22:00:26 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Hypervisor/Node resource view: name=user free_ram=9174MB free_disk=24.93124008178711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 22:00:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 22:00:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 22:00:26 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 22:00:26 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 22:00:26 user nova-compute[75285]: DEBUG nova.compute.provider_tree [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed in ProviderTree for provider: ec9ffc90-0859-4ab9-a65f-7415028d9d13 {{(pid=75285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 22:00:26 user nova-compute[75285]: DEBUG nova.scheduler.client.report [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Inventory has not changed for provider ec9ffc90-0859-4ab9-a65f-7415028d9d13 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 22:00:26 user nova-compute[75285]: DEBUG nova.compute.resource_tracker [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Compute_service record updated for user:user {{(pid=75285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 22:00:26 user nova-compute[75285]: DEBUG oslo_concurrency.lockutils [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75285) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 22:00:28 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:00:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:00:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:00:29 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:00:33 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:00:37 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:00:38 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:00:38 user nova-compute[75285]: DEBUG oslo_service.periodic_task [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75285) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 22:00:38 user nova-compute[75285]: DEBUG nova.compute.manager [None req-8badb646-dd4f-4e54-b3a3-5fa8f4029ece None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 22:00:43 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:00:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 22:00:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 22:00:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75285) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 22:00:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:00:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75285) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 22:00:48 user nova-compute[75285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75285) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}